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FOREWORD 


Efficient management of the Large Area Crop Inven- 
tory Experiment (LACIE) dictates that effective 
controls of project activities be established. To 
provide a basis for effective control, documentation 
will be prepared, baselines will be established, and 
changes to the baseline will be subsequently con- 
trolled by the proper management levels . 

The specific control documents which will be used 
are defined in the LAC IE Project Plan, Document 
LACIE-C00605 . All elements of the LACIE project 
must adhere to these baselined control documents, 
and, where it is considered that the requirements 
should be changed, the proper change request accom- 
panied by a full justification, must be submitted 
to the proper management level in accordance with 
established procedures. These documents will be 
maintained current by change notices and revisions 
as required. Each change notice and/or revision 
will reference the applicable Change Control Board 
Directive (CCBD) which approved the change. 

This document, LACIE-C00200 , Volume IV, Revision C, 
defines the LACIE Crop Assessment Subsystem Require- 
ments and has been prepared in accordance with the 
"Instructions for Preparation of LACIE Requirements 
Documents," LACIE-00 1 00 , Revision C dated November 20, 
1974. "Full-Up System," as used in this document, is 
defined as the system required to accomplish LACIE 
Phase II. In general, the approach used in each 
section is to first specify the requirements of 
the Full-Up System, and then to specify the require- 
ments of any interim systems by reference to specific 
paragraphs in the Full-Up System requirements sec- 
tions of the document. The LACIE Project Phases are 
defined in the LACIE Project Plan, LACIE-C00605 . 

The organization responsible for the implementation 
of each requirement defined in this document, is 
specified on an individual responsibility applies 
to the complete section, the implementation responsi- 
bility is specified after the section title. A "sec- 
tion" for the purposes of designating implementation 
responsibility is defined as being any numbered para- 
graph and all subparagraphs. Where different imple- 
mentation responsibility apply to different portions 

iv 




of a section, the implementation responsibility is 
specified on an individual paragraph or sentence 
basis, as applicable. All implementing organiza- 
tions designated shall accomplish their implementa- 
tion activities in accordance with the requirements 
specified herein. 


R. B. MacDonald 

Manager, Large Area Crop inventory Experiment 



CONTENTS 


Section Page 


1,0 FUNCTIONAL RESPONSIBILITIES .... . . . 1-1 


1.1 

GENERAL .... . 

• • 

• 

• 


. • 

• 

- .• 

• 

• 

• 

• 

9. 

• 

1-1 

1.2 

SPECIFIC . . . . 

• • 

• 

• 

. . 

• 




• 

9 

9 

1-2 

1.2.1 

Sample Strategy . 

*"V 



. 

• 

. 

• 

• 

• 

9 : 

4 : 

1-2 

1.2.2 

Wheat Area Estimation 

• 

• 

; * 


• 



• 

9 


1-2 

1.2.3 

Yield Estimates . 

• * 

• 

• 

•- 

• 

• 


• 



• 

1-2 

1.2.4 

Production Estimation 

• 

■ « 

■ • 

• 

• 

• 

• 

- • 

• 

• 

1-2 

1.2.5 

Compatibility of Crop 

Reporting 

- • 

• 


m 


1-3 

1.2.6 

Accuracy Assessment . 


' • ’ 

• 

• 


• 

• 

• 

9 

9 

1-3 

2.0 

APPLICABLE DOCUMENTS 

■ •- 

• 

• 

• * 

• - 

• 

• 




2-1 

3.0 r 

FUNCTIONAL FLOW DIAGRAMS 

• 

- • 


' • 



9 

•’ 

3-1 

3.1 

DEVELOPMENT . i- ..... . 

• - • 

• 

• 


• 





' 9 

• ;■ 

3-1 

3.1.1 

Full-Up System 

• ■ • 


• 

• 

• 


• 

• 

• 

• 


i 3-1 

3.1.2 

Interim System 

• • 

• 

• - 


• 

• 

• 

• 




3-1 

3. 2 

OPERATION .... 

• •' 

• 

• • 

• 

9- 

• 

• 


• 

• 

■9 

3-1 

3.2.1 

Full-Up System 

• • 


• 

• 



• 


• 

• 

9 . 

3-1 

3.2.2 

Interim System 

• • 


• 


• 

• 

' • 

• ' 

• 



3-1 

4.0 

REQUIREMENTS (CONSOLIDATED) 

• 



• 

. • 

■9 

9 ' 

4-1 

4.1 

CROP ASSESSMENT . 

• • 

• 

• 

• 

• 

• 

• 

• . 



9 

4-1 

4.1.1 

Full-Up System . 

• ■ • 

• 

• 

m 

• 

• 

• 

• 

* 


•' 

4-1 

4. 1.1.1 

Development . . . 


• 



• 

• 


• ' 


• 

. 9- 

4-1 

4.1 .1.2 

Operations . . . 


' • 

• 

m ■ 

• 


• 

• 




4-4 

4.1.2 

Interim System 

• • 


• 

• 

• 

• 

• 

• ' 

• 

• 

• ' 

4-1 0 

4.2 

ACCURACY ASSESSMENT . 




• 

• 


. • 



• 

4-10 

4.2. 1.1 

Approach .... 

• • 

• 

• 


• 

■ • 

• 

9 

• ■. 

• 

• 

4-10 

4. 2. 1.2 
4,2. 1.3 

System development 
Design philosophy 


• 


• • 

• 





• 

• 

4-10 

4-12 

• . • 


• 

• 


• 

• 

• 

• 

• 


4. 2. 1.4 

CAS accuracy assessment 

operation 

• 


4 

• 

4-13 

4.2.2 

Interim System 

• '■ ' • • ■ 

• 

• 

• ' . 

• 


• 

• 




4-13 

5.0 

INPUT REQUIREMENTS 


* 


• 

• 


• 

• 



. i- 

5-1 

5.1 

CROP ASSESSMENT . 

• • 

■ 

• 



• 

• 

' • ' 


• 


5-1 

5.1.1 

Full-Up System 


■ • 


. • 



• 

• 

• • 



5-1 

5. 1.1.1 

DAPTS 


• 

• ' 


• ' 



• 




5-1 

5.1. 1,2 

CAMS 

• . . * 

. 

• 

* 


-• 

• . 

• 

• 



5-4 

5.1 . 1.3 

YES 

• • 



• • 

• 

• ■ ' 


' • . 

• 



5-11 

5. 1.1. 4 

CAS 

« 9 ■ 


• 









5-13 

5. 1.1. 5 

ISRRS 



• 

• 



• * 

• • 

- • 

• • 

• 

5-15 

5. 1.1. 6 

SPE ....... 



■ 




. • 


•’ • 


• 

5-16 


vi 


Section 

5.1. 1.7 

! ■" 

i ■:-■■■■ 

! I !. 

i T R 1 

X U * • A A • • A A • * • 

• 

• 

• 



A 

A 

A 

Page 

5-16 

5. 1.1. 8 

Research . . . . ,. . . . 

• 


• 

• 

A 

A 


A 

5-10 

5. 1 . 1 . 9 

Test and evaluation . . 

• 


• 

• 

A 

A 

A 

A 

5-16 

5.1.2 

i Interim Systems .... 

• 

A 

•A 

• 


A 

A 

A 

5-16 

5.2 

; ACCURACY ASSESSMENT . . 

• 

. • 


• 

■A 

A 


A 

5-16 

5.2.1 

Full-Up System 

A 

• 

• 

• 

A 

A 

A 

A 

5-16 

5.2. 1 .1 

DAPTS . 

• 


<* 

A 

A 

A 

A 

• 

5- 1 6 

5.2.1 .2 

CAMS .... 

• 

• 

• 

• 

A 

A 

A 

A 

5- i f J 

5.2. 1 .3 

YES 

A 

• 


A 


A 

A 

A 

5-20 

5.2.1 .4 

CAS .......... 

' A 

• 

• 

A 

A 

A 

A 

A 

5-21 

5.2. 1 .5 

ISRRS . . . . . • ... 

• 

• 

• 

A 

A 

A- 

A - 

A 

5-22 

5.2. 1 .6 

SPE . . . ... ... . 


• 

• 

A 

A 

A 

A 

• 

5-22 

5.2.1 .7 


* 

9 

• - 

• 

A 

A ' 

: A 

A 

5-22 

5.2. 1 .8 

Research . . . . . . . . 




A 

A 

A 


A 

5-22 

5.2. 1.9 

Test and evaluation . . 




A 


A 

A 

A 

5-22 

5.2.2 

Interim System ..... 

' •' 

• 

• 

A 

A 

A- 


• 

5-23 

6.0 

OUTPUT PRODUCTS . . . . 

• 

• 

• 

a' 

A 

A 

• 

A 

6-1 

6.1 

CROP ASSESSMENT . ... 

• 

• 

• 

A 


A 

A 

A 

6-1 

6.1.1 

Full-Up System . . . . . 

• 

• 

• 

A 


A 

A 

A 

6-1 

6.1 ,1 .1 

DAPTS .... 

• 



A 

A 

A 

' A' 

A 

6-1 

6. 1 . 1 .2 

CAMS 

• 

• 

• 

A 

A 

A 

A 

A 

6-2 

6. 1.1. 3 

YES 

.A 

• 

• 

A 

A 

A 

A 

A 

6-3 

6. 1.1. 4 

CAS . . 

• 

• ' 

• 

A 

A 

A 

A 

A 

6-3 

6.1 ,1 .5 

ISRRS ......... 

• 

• 

• 

A 


A 

A 

A ' 

6-6 

6.1 *1 .6 

SPE • ••• •••... 

• 

A 



A 

A 


A 

6-6 

6. 1.1.7 

IE . . . 


• 

• 

A 

A 

A' 

A 


6-6 

6.1 il .8 

Research ........ 

• 

• 

• 

A 

A 

A 


A 

6-6 

6.1 .1.9 

Test and evaluation . . 

• • 

• 

• 

A 


A 

A 

A 

6-6 

6.1.2 

Interim System 

• 

• 

• 

A 

A 

A 

A 

A 

6-7 

6.2 

ACCURACY ASSESSMENT . . 


■ • 

• A 

A 

A 

A 

A 

A 

; 6-7 

6.2.1 

Full-Up System 

• 

• 

A 

A 

A 

A 

A 


6-7 

6.2. 1 .1 

Accuracy estimates . . . 

• 



A 


A. 

A 

A 

6-7 

6. 2. 1.2 

Discrepancy evaluation , 

A • 



A ’ 

A 

A 

A 


6-7 

6. 2. 1.3 

System testing ..... 




A 


A 

A 

■ A 

6-7 

6.2.2 

Interim Systems .... 

A 








6-7 

7.0 

INTERFACE REQUIREMENTS . 

• 

• 

• 

A 

A 

A 

A • 

A 

7-1 

o 

A- 

GO 

OPERATIONAL REQUIREMENTS 
AFFECTING THE DESIGN . 

• 

• 

• 

A 


A 

A' 

A 

8-1 

8.1 

CROP ASSESSMENT . . . . 

• 

• 

• 

A 

A 

A 

A 

A 

8-1 

8.1.1 

Throughput Requirements 


• 

A 

A. 

A 

A 

A 

A. 

8-1 

8.1.2 

Response Requirements 

• 

• 

A ' 

A . 


A 

A\ 

• A 

8-1 

8.1.3 

Reliability Requirements 




A 




A 

8-1 

8.1 .3.1 

Data base ....... 


• 


■: A.' ' 

A 


A 

; A 

8-1 


vii 


Section 

8.1*4 

8.1.5 

8 . 1.6 
8.1.7 
8.2 
8 . 2*1 
8 . 2.2 

8.2.3 

8.2.4 

8.2.5 

8 . 2.6 

9.0 

9.1 

9 . 2 

I 

10.0 

10.1 

10 . 1.1 

10.1.2 
10 . 1 . 2. 1 
10 . 11 . 2.2 
10.1.2.3 
10. 2 
10 . 2.1 

11.0 
1 1. 1 
11.2 

Appendix 

A 


B 


C 


D 


Page 

S ecurity Requirements . ,. , . . 8-1 

D elivery Requirements . ... . . . ......... . . 8-2 

Q uality Assurance Requirements 8-2 

Other Operational Requirements 8-2 

ACCURACY ASSESSMENT . ... ....... 8-2 

Throughput Requirements ......... 8-2 

Response Requirements . . . , . . . . . . 8-3 

R eliability Requirements . . . . ... .... 8-3 

S ecurity Requirements 8-3 

Delivery Requirements . 8-3 

Quality Assurance Requirements ..... 8-3 


VERIFICATION REQUIREMENTS ........ 9-1 

CROP ASSESSMENT ...... 9-1 

ACCURACY ASSESSMENT ........... 9-1 


RESEARCH REQUIREMENTS . . . 
CROP ASSESSMENT . . . . . . 
Pre-Phase I . . . . ... . 
Desirable Approaches . . . 
Sampling ......... 

Aggregation ........ 

Harvested Wheat . . . . . . 
ACCURACY ASSESSMENT . . . . 
Error Model ........ 


1 0-1 
10-1 
10-1 
10-1 
10-1 
1 0-2 
10-3 
10-3 
10-4 


TEST AND EVALUATION REQUIREMENTS .... 11-1 

CROP ASSESSMENT 11-1 

ACCURACY ASSESSMENT ........... 11-1 


SAMPLE SEGMENT ALLOCATION 

PROCEDURE FOR U.S.A. ......... A-1 

SAMPLING AND ESTIMATION PLAN B-1 

HARTLEY-RAO PROCEDURE FOR PPS 

SAMPLING .... . . . . ... . . C-1 

SAMPLING AND ESTIMATION PROCEDURE BASED 

ON NATURAL STRATA . .... . . . . . . D-1 


viii 


FIGURES 


Figure 
3- 1 

3-2 

3-3 

3-4 

3-5 

3-6 


Page 

CAS subsystem development of 

crop assessment . 3-2 

CAS accuracy assessment full-up 
system development functional 

flow diagram ......... e . . . 3-3 

Functional flow diagram of electronic 

crop area estimate within CAS ..... 3-4 

Functional flow diagram of electronic 

yield estimate within CAS ....... 3-5 

Functional flow diagram of electronic 

production estimate within CAS .... 3-6 

CAS accuracy assessment full-up 
system operational functional 

flow diagram . 3-7 


ix 


ADP 

AES 

AI 

ASM 

ASCS 

ASVB 

GAS 

CAMS 

CATEGORY 1 

CATEGORY 2 

CATEGORY 3 

CATEGORY 4 

CCBD 
CCT 
Cl TARS 


GLOSSARY 


Automatic Data Processing 

Application Evaluation System 

Analyst Interpreter 

Agricultural and Mechanical 

Agriculture Stabilization and Conservation 
Service 


Applications System Verification Branch 

Crop Assessment Subsystem 

Classification and Mensuration Subsystem 

Category 1 requirements are those which can be 
understood to the degree that definite action 
can be taken to satisfy the requirement; i.e., 
the requirement is defined to the extent required 
for implementation by the implementing organization 

Category 2 requirements are those which can be 
understood to the degree that action can be 
initiated but further definition of the require- 
ments will be necessary for complete implementa- 
tion. 

Category 3 requirements define a general area 
in which a requirement exists but the require- 
ment needs to be further defined before implemen- 
tation can be initiated. 


Category 4 requirements are those which may or 
may not be levied at some time in the future; 
i.e. , they consist of items which are still being 
considered for possible implementation. 

Change Control Board Directive 

Computer Compatible Tape 

Crop Identification Technology Assessment for 
Remote Sensing 


CPU 


CRD 

CS 

DAPTS 

DSAD 

E 

EOD 

EP 

ERS 

FAS 

Full-Up 

System 

FY 

GDSD 

GSFC 

GSR 

ICD 

ID 

IE 

Interim 

System 

I/O 

ISRRS 

JSC 


Central Processing Unit 
Crop Reporting District 
Civil Servant 

Data Acquisition, Preprocessing and 
Transmission Subsystem 

Data Systems and Analysis Directorate 

East 

Earth Observations Division 
Error Parameters 
Equipment Record System 
Foreign Agriculture Service 

System required to accomplish LAC IE Phase II 
Fiscal Year 

Ground Data Support Division 
Goddard Space Flight Center 
Green Support Room 
Interface Control Document 
Identification 
Information Evaluation 

System requirements to accomplish subphases of 
LAC IE Phase I, excluding subphases IA and IB 

Input/Output 

Information Storage, Retrieval, and 
Reformatting Subsystem 

Johnson Space Center 
xi 


K 

LAC IE 

LACIE PO 

Landsat 

LEC 

MSS 

NASA 

NOAA 

Out of Sync 

ONC 

PPC 

PPS 

RED 

Pseudo- 

county 

RTEB 

S 

S6AD 

SPE 

SRS 


Thousands (kilo) 

Large Area Crop Inventory Experiment 
LACIE Project office 
Land Satellite 

Lockheed Electronics Company 
Multispectral Scanner 

National Aeronautics and Space Administration 
National Oceanic and Atmospheric Administration 
Not synchronized 
Operational Navigational Chart r. 

Production Film Converter 
Probability Proportional to Size 
Research and Development 

Aggregates of 5- by 6-mm rectangles whose center 
points lie within actual county boundaries 

Research Test and Evaluation Branch 

South 

Science and Applications Directorate 
System Performance Evaluation 
Statistical Reporting Service 


Standard Standard deviation, coefficient of variation, 

Statistics bias, and confidence level 

TEE Test and Evaluation 

TBD To Be Determined 


xii 


US DA 

VIP 

W 

WMO 

YES 


United States Department of Agriculture 

Very Important Person 

West 

World Meteorological Organization 
Yield Estimation Subsystem 


xiii 


SECTION 1.0 

FUNCTIONAL RESPONSIBILITIES 


GENERAL 


The CAS will consist of multidiscipline analyst/ 
software capabilities for which responsibilities 
include: 

A. Providing, qn a monthly basis, the area, yield, 
and wheat production from planting through post- 
harvest. Phase I responsibilities will be area 
estimation for the Applications Evaluation 
effort, as well as yield and production for 

the T£E and R6D efforts. Phase II responsibil- 
ities will include area, yield, and production 
reports in the AES, 

B. Development of a sampling strategy and defini- 

tion of sample segments for area and production 
calculations . ■ ■ / Zi/ 

C. Insuring that related LACIE subsystem's outputs 
will bt properly compatible within the crop re- 
porting system for eventual transfer into a 
USDA operational environment. 


D. Providing criteria and procedures for the assess- 
ment and evaluation of LACIE reports in terms 

of USDA requirements and in consideration of 
established performance goals and cost benefit 
criteria. 

E. Investigating discrepancies in the LACIE area, 
yield, and production reports identified by the 
USDA evaluation of the information contained in 
these reports. (If the source of the discrepancy 
is determined to be within the AES, the CAS 
will analyze and report the causes and make 
recommendations . ) 


1-1 


1.2 


f I 

x 


SPECIFIC 


1.2.1 Sample Strategy 

A. Definition and delineation of agricultural 

sampling areas 'I I 

B. Insure adequacy of sampling strategy for LAC 1.E 
requirements 

1 « Develop and utilize a sample strategy to 
select the number and location of the 
sample segments required to estimate accu“ 
rately the wheat area. 

2. The sample strategy will be tested on a 
limited basis prior to Phase I. 

3. The results of the sample strategy will be 
monitored during Phase I operations and 
the strategy will be improved as required 
for use in Phase II. 


1.2.2 Wheat Area Estimation 

In Phases I and II , the CAS will incorporate CAMS 
wheat proportion estimates into the crop area ag- 
gregation model to obtain monthly estimates of area 
by strata , Zone, region, and country. 


1.2.3 Yield Estimates 

In Phase II, the CAS will utilize the stratum and 
zone average yields supplied by the YES to provide 
monthly estimates of the yield for the regions and 
countries . S' 


1.2.4 Production Estimation 


In Phase II, the CAS will operate the crop-production 
model to obtain monthly estimates of crop production 
based on the products of area and yield determined 
by the CAMS and the YES, aggregated to production 
values for strata, zones, regions, and country. 
Production estimates for a geographical area (country, 

1-2 






region, etc.) will be an upward aggregation of 
production estimates of its subareas. 


1.2.5 Compatibility of Crop Reporting 

The CAS will insure that the LACIE output reports 
are compatible with the USDA crop reporting system 
to allow eventual transfer into the USDA operation. 
The CAS will provide the criteria and procedures for 
the assessment, and evaluation of the LACIE output 
products to meet USDA requirements. 


1.2.6 Accuracy Assessment 

The CAS will monitor and evaluate the development 
activities and products of the CAMS, CAS, and YES, 
and track AES parameters in sufficient detail to 
provide an assessment of the reliability and ac- 
curacy of the area, yield, and production estimates 
issued by the LACIE. Any deficiencies will be re- 
ported to the AES and Quality Assurance Managers, 

The CAS will define the ground truth requirements 
necessary to support this activity. The CAS will 
also provide assistance to the Washington USDA 
LACIE staff in the following areas: 

A. Identify additional information processing 
support software/hardware requirements for 
the USDA based on operating experience and 
user requirements. 

B. Develop TSE criteria and procedures for the 
LACIE system. 



C. Supervise the application of criteria and 
procedures in B. to a USDA test bed system. 



I 


Participate in and monitor ongoing research 
and development efforts. 
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SECTION 2.0 



APPLICABLE DOCUMENTS 


The following documents are applicable to the 

extent specified hei~ein: 

A. LACIE Project Plan, LACIE-C00605 , dated 
August, 1975. 

B. Instruction for Preparation of LACIE Require- 
ments Documents, LACIE- 001 00, Revision C, dated 
November 20, 1974. 

C. GSPC/JSC Interface Control Document, LACIE- 
00701, dated March 20, 1975. 

D. LACIE Requirements Documents, LACIE-C00200 
(Revision A) Volumes IA, IB, IC, ID, IE, II, 

IV, V, VI-A, dated December, 1975 and LAC IE- 
00200 Volumes III, VI-B , VII, VIII, IX, dated 
December, 1974. 

E. LACIE Subsystem Procedures Documents - TBD. 

F. LACIE Operations Plan, LACIE-C00602 , dated 
July 11, 1975 and LACIE Operations Plan, 

Phase II, LACIE-C00606 , dated September, 1975. 

G. LACIE Rescope Document, LAC IE-00401, Volume I, 
dated April, 1975. 

H. USDA/NASA Interface Control Documents, Volume 

I, LACIE-C007 05 , dated April, 1976, and Volume II 
(Revision A), LACIE-C00707 , dated April, 1976. 

I. LACIE User's Manual • 

J. NOAA/NASA/USDA Interface Control Document, LACIE- 
C00710, dated December, 1975. 

K. CAS/IE Interface Control Document, LACIE-C00709 , 
dated December, 1 975 . 



SECTION 3 . 0 

FUNCTIONAL FLOW DIAGRAMS 

3.1 DEVELOPMENT 


3.1.1 Full-Up System 

The development of the CAS crop assessment opera- 
tional functions is shown in figure 3-1, and the 
development of the accuracy assessment is shown in 
figure 3-2 . 


3.1.2 Interim System 

The development: of the Phase IC portion of CAS crop 
assessment is shown in figure 3-1 as the top two 
flow diagrams for sample strategy and area calcula- 
tion. No operational accuracy assessment is being 
developed for the interim system. 

3.2 OPERATION 


3.2.1 Full-Up System 

The full-up operational CAS crop assessment is shown 
in figure 3-3 to 3-5. The operational accuracy 
assessment flow is shown in figure 3-6. 


3.2.2 Interim System 

The Phase IC portion of CAS crop assessment is shown 
in figure 3-3 (area only) . No operational accuracy 
assessment is conducted on the interim system. 
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Figure 3-6.- CAS accuracy assessment full-up system 
operational functional flow diagram. 
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SECTION 4.0 


REQUIREMENTS (CONSOLIDATED) 


4.1 CROP ASSESSMENT 


4.1.1 Full-Up Syste m - 

4. 1.1.1 Deve lopment . - (Required by CAS; Category 1; Imple- 
mentation Responsibility: CAS/LAC IE- AS VB using GDSD 

computers). Agricultural records# Land sat mosaics, 
and maps for the smallest reporting subdivisions of 
the desired countries are used together with the 
effects of cloud cover as inputs to develop a sam- 
pling strategy for crop area estimation. The strategy 
is designed to achieve a 2 percent (or less) coef- 
ficient of variation Landsat (2 percent sample error), 
using analyzed data from segments 5x6 n. mi * which 
are placed in accordance with the constraints and 
throughput constraints received from Goddard and 
GDSD. The output products are the sample segment 
location, definition of each segment as spring or 
winter, and definitions of substrata, strata, zones, 
and regions. Requirements are UNIVAC 1110 and 1108. 
Reference Appendix D, 


4. 1.1. 1.1 Sampling Strategy: (Required by CAS; Category 1; 

Implementation Responsibility: Systems Engineering/ 

CAS-SFB) . The sampling strategy developed during 
LACIE Phases I and II (stratification on political 
boundaries) as modified in Phase III will be utilized 
in U.S. Great Plains 6 USSR during Phase III S in 
USSR and other LACIE countries during Transition. 
Appendices A 6 B of this document detail this sam- 
pling strategy. A new sampling strategy (stratifica- 
tion using natural elements, referenced as the univ- 
ersal strata or partitioning) will be implemented 
in selected areas for testing during LACIE Phase III 
and for the Great Plains during Transition. Appendix 
E of this document details this new sampling strat- 
egy. These requirements are for the PDP 1 1/45. 
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4 . 1 . 1 . 1.2 Aggregation procedures and software for area: 
(Required by CAS; Category 1; Implementation 
Responsibility: CAS/LACIE-EOD) . Once the sampling 

strategy is defined and has been used to define the 
locatidn of the segments, substrata, strata, zones, 
and regions, procedures and software will be com- 
pleted to utilize the percentage of wheat from clas- 
sified Landsat segments to determine crop area for 
each strata, zone, region, and country. Software 
is to be implemented on an interactive computer. 
(Batch processing capability is required operational 
on 10/1/75 and interactive capability on the PDP 
11/45 on 4/1/76.) 


4. 1.1. 1.3 Average yield procedures and software: (Required 

by CAS; Category 1; Implementation Responsibility: 
CAS/LACIE-EOD). Once the strata, zones, regions, 
and meteorological stations are defined, procedures 
and software can be completed to calculate average 
yield for each region and country. Software is to 
be implemented on an interactive computer. 


4.1. 1 ,1.4 Integration software for calculation of production 
from yield and area: (Required by CAS; Category 1; 

Implementation Responsibility: CAS/LACIE-EOD) . 

Once the segments and strata are defined procedures 
and software can be completed to utilize average 
stratum yield and percentage of wheat from individ- 
ual segments to calculate production for individual 
strata. Software is to be implemented on an inter- 
active computer. (Batch processing capability is 
required operation on 10/1/75, and interactive 
capability is required operational on 4/1/76.) 


4. 1.1. 1.5 Aggregation procedures and software for production: 
(Required by CAS; Category 1; Implementation Respon- 
sibility: CAS/LACIE-EOD) . Once the sampling strat- 

egy is defined and procedures and software developed 
for integration of yield and area into production, 
procedures and software can be developed to aggregate 
production for each zone, region, and country. Soft- 
ware is to be implemented on an interactive computer. 
(Batch processing capability is required operational 
on 10/1/75 and interactive capability operation 4/1/76.) 



4. 1.1. 1.6 Ancillary information: (Required by CAS; Category 

3; Implementation Responsibility: CAS/USDA) . De- 

vise procedures for modifying yield, area, and pro- 
duction estimates interactively using information 
synthesis techniques to incorporate ancillary in- 
formation. Information such as FAS attache reports, 
FAS country analyst reports, weather-related infor- 
mation on insects, crop disease, crop-management 
factors, and other TBD reports will be incorporated 
into the area and production forecasts. 


4.1.1. 1.7 Error estimates; (Required by CAS; Category 1; Im- 
plementation Responsibility: CAS/LACIE-EOD) , Pro- 

cedures and software will be designed to calculate 
standard statistics of area, yield, and production 
estimates using the ratio of true county agricultural 
area, estimated error in percent wheat from CAMS, 
standard statistics from YES, historical wheat area, 
yield and production for stratum, zone, region, and 
country, area stratum ID, bio-phase, and date of 
acquisition. (Batch processing capability is re- 
quired operational on 10/1/75 and interactive capa- 
bility on 4/1/76.) 


4. 1.1. 1.8 Modify crop area, yield, and production software; 

(Required by CAS; Category 3; Implementation Re- 
sponsibility: CAS/LACIE-EOD) . Modify area yield, 

and production estimating software and procedures, 
if required, based on the results obtained in 
Phases I and II. 


4. 1.1. 1.9 Devise procedures for choosing sample segments: 
(Required by CAS; Category 1; Implementation Re- 
sponsibility: CAS/LAC IE- ASVB ) . Procedures will 

be defined and documented for choosing sample seg- 
ments based on the sample strategy defined in 
4. 1.1.1. These step-by-step procedures and equip- 
ment are defined to a level of detail that will en- 
able persons with photointerpretation, country 
analysts, and mensuration backgrounds to carry out 
all required functions. See Appendix B. 
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4. 1. 1 . 1.10 /JSDA Compatible Outputs: (Required by LAC IE PO; 

Category 3; Implementation Responsibility: CAS/ 

LAC IE- AS VB). The CAS will determine the report 
format and content of the current crop reporting 
system of the US DA, and insure that the proposed 
reports generated by the LAC IE AES are compatible. 
Any discrepancies will bp rectified with the con- 
currence of the LACIE PO and USDA. The objective 
is to insure that the LACIE output products can be 
integrated into the USDA reporting system, if re- 
quired, in the future. 


4.1.1.1.11 Software to be developed: (Required by LACIE; 

Category 4? Implementation Responsibility: CAS/ 

EOD) . Software will be developed to use area, 
yield, and production for each month for years 
i— 1 , i-2, etc., to calculate area, yield, and 
production for year i-2, etc. for each stratum. 

4.1.1.1.12 Test of area, yield, and production procedures and 

software: (Category 1? Implementation Responsi- 
bility: CAS/LAC IE-F SO) . The procedures and soft- 

ware for estimating the area, yield, and production 
to the country level will be tested prior to im- 
plementation in the AES. Batch processing test 
complete by 10/1/75 and interactive test complete 
by 4/1/76. 

4.1.1.1.13 Select segments for each LACIE country: (Required 

by CAS; Category 1 ; Implementation Responsibility: 
CAS/LACIE-ASVB) . Sample segments are chosen using 
techniques described in the procedures document 
(4.1.1.1.10) at the rate of about 50 segments/day 
for a total of 4800 segments. This task is redone 

annually if required, and requires Landsat mosaics 

£ 

and maps of 1 : 10 scale, Landsat constraints over- 
lays, nonagricultural areas defined 5x6 n. mi. grid 
overlays, and 5x6 n. mi. center point overlays. 


4. 1.1. 2 Operations .- The full-up system will consist of es- 

timating wheat area, yield, and production by 
stratum, zone, region, and country . I'hese pa- 
rameters will be determined monthly from planting 
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to postharvest. Initial operations in the batch 
mode on the PDP 11/45 are required by 10/1/75, 
and full-up operation in the interactive mode on 
the PDP 41 / 4,5 is required 4/1/76, 

Calculate total wheat area per stratum: (Required 

by CAS? Category 1? Implementation Responsibility: 
CAS/LACIE-ASVB) . There are up to 60 sample segments 
(in the U.S. there is usually one segment per county) 
contained within each area stratum depending upon 
the amount of wheat grown in the area, and the 
stratum size. The sample segment percent wheat, 
correlated with the area devoted to wheat is deter- 
mined from the sample segments. This is then com- 
bined with the historical area of wheat within that 
stratum to obtain an estimate of the current spring 
and! winter wheat area. If drastic changes in wheat 
grown (as determined from the sample segments) occur, 
the segment will be flagged for checking, or pos- 
sible reclassification by the CAMS. This operation 
is performed for all area strata within a country. 

CAS requires the ability to aggregate CAMS classi- 
fication data by six (6) subclasses (i. e. , all small 
grains, spring small grains, winter small grains, 
spring wheat, winter wheat, and other), as reported 
in the CAMS classification summary. The spring and 
winter wheat subclasses are required to produce 
spring and winter wheat area estimates. In addi- 
tion, CAMS classification results that are provided 
to CAS include the subclasses of small grains, win- 
ter small grains, and spring small grains. The 
ability to aggregate areas on a subclass basis is 
required and also the ability to derive the wheat 
area estimate when confused with small grains re- 
quires ratioing out the small grains based on the 
ratio of wheat to small grains from the previous 
year's historical data. 

CAS requires the ability to aggregate data by bio- 
stage, ordering the biostages, or combinations of 
biostages. Biostage or growth stage information 
is used in crop identification on Landsat data and 
provides a measure for analyzing the best area iden- 
tification results for CAMS. While multiple Landsat 
passes of equal quality exist, biostage ordering 

4-5 ; 


• ir.": r:r:; " ■ ' ' . . . , i., 

allows for the selection of the best data f or area • ' 
aggregation. The CAS analyst shall have the option 
of aggregating by subclasses, wheat only from ratioed 
subclasses, and by a single biostage or group of 
bios'tages in any order up to seven (7) biostages. 

Using the sample segment percent wheat (and notation 
in terms of suitability for aggregation), the sample 
segment identification, wheat growth stages, dates 
of acquisition, strata ID, nearest neighbors to 
each stratum, historical agricultural data, ancil- 
lary area data, and the area strata software, the 
estimates of wheat area per stratum will be calcu- 
lated using interactive software and computers. 

Output will include historical data, report number, 
date of reports, strata, zone, region, country, etc. 

This will be done about twice per month per stratum. 

Initial operation required 10/1/75. 

The CAMS two digit (00-99) evaluation codes 
(5.1.1.2.1B) determine the suitability of a segment 
classification for aggregation according to the 
following description: 

00-09 Data is not processed by CAMS and is not 
used for aggregation. 

10-19 Classif iation data is unsatisfactory. 

20-29 Classification data is marginal. 

30-39 Classification data is satisfactory. 

40 Segment is totally nonagricultural but 

can be used in an aggregation. 

The CAS analyst selects the numerical value of the 
codes or the range to be aggregated. In the 'case 
of multiple data in the same biowindow the logic 
should select the latest acquisition within the 
code threshold. In the case of codes 12, 22, and 
32, which designate no significant change from last 
classification, the proportion classified for the 
segment is obtained from the last previous unsat- 
isfactory, marginal, or satisfactory evaluation code , 
respectively. 
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4.1 .1 .2.2 Calculate standard statistics of wheat area per 

stratum, zone, region, and country: (Required by 

CAS; Category 1; Implementation Responsibility: 
f*AS/ LACIE-ASVB) . The estimated error in percent 
wheat, standard deviation in the historical wheat 
area, estimated wheat area in each stratum, number 
of sample segments acquired, sample segment ID, 
area of strata, zone, etc; historical wheat area 
C)f strata, zone, etc; strata ID; biophase; and ratio 
of true county agricultural area to pseudo-county 
area, will be used to calculate the standard sta- 
tistics of wheat area per zone, region and country. 
Same frequency as 4.1 .1.2.1 with initial operation 
required 1 0/1/75. 


4. 1.1. 2. 3 Calculate area aggregation: (Required by CAS; 

Category 1; Implementation Responsibility: CAS/ 

LACIE-ASVB) . Using the area aggregation software, 
tjhe CAMS proportion of wheat for each strata, his- 
torical agricultural data; nearest zone neighbors; 
zbne, region, and country descriptors; calcula- 
tions are made of the wheat area for zones, region, 
and countries and reported and stored in the CAS 
and ISRRS . Each level will be done " inter actively" 
twice per month when a significant number of the 
segments in an area have been analyzed. Output 
will also include ancillary data similar to strata 
report (see section 4.1. 1.2.1). Each time an area 
report is generated, these data are then available 
for reporting' purposes by the CAS, and no report 
storage is required in the computer. The data from 
the replaced reports are stored. These new data 
are treated as speculative data. Batch operation 
required on 10/1/75 and interactive operation on 
lib;,' ' 4/1/76. b-W- ^ 


4 . 1.1 .2.4 Calculate yield and production: (Required by CAS; 

Category 1; Implementation Responsibility: CAS/ 

LACIE-ASVB). The subsystem operates a computerized 
crop aggregation model that will obtain a monthly 
estimate (beginning 4/1/75) of the average yield 
and production by strata, zone, region, and country. 
The computed yield and area are obtained from stor- 
age. Calculation of the standard statistics asso- 
ciated with the yield and production estimates is 
also required • 

4-7 .lb-' 


.'.... ' :»-• ieg yOBgaf^g-. -W W* U 


f ' 

jj : 

' //■ '■ ■' '■'■ 'I ■ : V; : - 

. yf ; : ’’ ; 

A. The following inputs are required: 

1. Yield value of each area stratum. 

2. Meteorological station coordinates - lati- 
tude and longitude in degrees and minutes. 

| (E, W and N, ’ S) . 

3. 1 Ancillary data. 

4 . 1 — Yield strata boundaries. 

5. Historical yield for 15 years. 

6. Yield coefficients for each stratum. 

7. In addition to these inputs, tracking of 
errors through the calculations requires 
the standard statistics for each yield 
value. 

B. Thje yield and area estimates are integrated t.. 1 
obtain a production estimate for each area 
stratum. The yield and wheat area estimates 
fo;r the strata are used to calculate production 
for each stratum. An average production for 
each stratum is calculated and modified by the 
ancillary data if data from that stratum are 
available. The production is aggregated to 
the zone, region, and country levels. The pro- 
duction at the country level is again modified 
based on ancillary data, if required, and then 
reported. Speculative data are generated. 

C. The output of the CAS is designated speculative 
information, and access to the data and reports 
must be controlled. Proposed outputs are in- 
cluded in appendix A. 


4. 1.1. 2. 5 Calculate standard statistics of production for 

stratum, zone, region, and country: (Required by 

CAS; Category 1 ; Implementation Responsibility: 
CAS/LAC IE-ASVB ) . The estimated production and 
yield in each stratum together with inputs required 
in 4.1.1. 2. 2 will be used to estimate the standard 
statistics of production at all higher levels. Same 
frequency as 4 . 1 .1.2.1 . 
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Software and Hardware Design Constraints: (Re- 

quired by CAS, Category 1, Implementation Respon- 
sibility: CAS/LACIE-ASVB) . The aggregation soft- 

ware will bo designed to incorporate CAMS area 
measurements together with historical data to pro- 
duce wheat area estimates for the substrata, strata, 
zone, region, and country. In Phase II, yield will 
be factored in to estimate production. The system 
will be operated by the CAS analyst from a CRT 
terminal (s) with line printer (s). The analyst will 
be able to operate the aggregation interactively 
or in batch mode. In the latter mode he will des- 
ignate an area (by strata, zone, region or country), 
user name and user code and aggregations will be 
performed at all levels up to that point, with a 
results report being printed for that highest 
aggregation level. Printouts of lower level ag- 
gregations can be called for on a one-by-one or 
on a group basis as desired. The analyst can also 
generate aggregations manually, one at a time, to 
correct previous reports. The batch mode may then 
be used to aggregate upward to correct higher level 
reports. (Batch operation required 10/1/75 and 
interactive capability on 4/1/76.) 

Reports listing all data in the CAS data base, must 
be available to the CAS analysts. 

All data in the DAS data base (including input) can 
be modified by the CAS analyst. However, each change 
must be accompanied by a change report which gives 
the time, day, month, and year, name of the person 
making the change, old data, new data, report changed 
copy of affected report with change denoted by $, , 
or * on both sides of change, and reason the change 
was made. i 

If errors are detected after a report is generated 
(e.g., report for Kansas for April) a capability 
must exist to go back and change this aggregation 
and generate a new report even though the error 
cquld have occurred 6 months or 1 year ago. 

Normally, substrata reports and yield strata will 
not be called for? however, when problems occur 
these reports will be called for by the analyst. 
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4.1. 1.2. 7 Monitor and record: (Required by SPE; Category 

2; Implementation Responsibility: CAS/LACIE-ASVB) . 

On a weekly basis, the following information ex- 
pended in the preparation of area, yield, and pro- 
duction estimates for each country for TBD phases. 

A. Manpower: Category, number of people per 

category, man-hours per category, categories 
TBD. 

B. Computer time (CPU and I/O): Designation of 

computer system and number of hours expended. 
(Implementation Responsibility: EOD develop 

software to track this time)* 


4.1.2 Interim System 

Not applicable. 

4.2 ACCURACY ASSESSMENT 

4.2.1 Full-Up Systems 


4. 2. 1.1 Approach .- The LAC IE system will utilize remote 
sensor data; the location of which will be selected 
by a probability area sampling technique to esti- 
mate crop area, yield’ and production over a large 
area. In most previous uses of Landsat data, ground 
information has been used to provide known levels 

of accuracy. This may be impractical in LAC IE 
where Landsat data must be processed for areas 
where ground information is not available. An 
alternate approach will be developed, which monitors 
various aspects of the LAC IE components and through 
a model which interrelates these aspects, to pro- 
vide an estimate of the reliability and accuracy 
of the LAC IE outputs. This model will be verified 
and update continuously during the LAC IE using data 
as acquired for the intensive study sites. 

4.2. 1 .2 System development . - The system development is as 
follows. 
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A. The CAS will provide an assessment of the 

accuracy/precision for each area, yield, and 
production estimate made by the LAC IE using 
mathematical models to synthesize system be- 
haviour. The system model will be developed 
by first analyzing the LAC IE system and iden- 
tifying possible sources of error. Initially, 
the LAC IE requirements, procedures, and oper- 
ating documents will be reviewed. In addition, 
monitoring of system simulation, training, and 
operations will also aid in identifying pos- 
sible error sources. (Required by CAS; Cate- 
gory 3; Implementation Responsibility: CAS/ 

LAC IE- AS VB . ) 

B. The importance of the various errors identified 
for the system will be evaluated. This evalua- 
tion will be made using data from three sources 

1 . Data obtained from previous investigations 
into the use of Landsat data such as those 
obtained during the CITARS project will be 
evaluated. In particular, the results of 
the individual segment analyses and the re- 
sults of the CITARS analysis of variance 
will be analyzed. (Required by CAS; Cate- 
gory 3; Implementation Responsibility: 
LACIE-RTEB.) 

2. A major source of data for the model devel- 
opment will be that obtained from the LAC IE 
Test and Evaluation studies. A number of 
controlled experiments will be carried out 
toj isolate the various components of the 
system, and how they individually vary 
relative to some associated parameters. 
These experiments will be designed by T6E 
anjd concurred on by the CAS, (Required 

by; CAS; Category 3; Implementation Respon- 
sibility: LACIE-RTEB.) The results of 

thje Test and Evaluation studies will pro- 
vide the basic input for the LACIE error 
model development. Detailed requirements 
are defined in section 11.2. 

3. The magnitude of the various errors to be 
encountered by the system will also be 
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quantified by monitoring the processing j 
of LAC IE Intensive Test Site data during 
training, simulations, and LACIE operation. 
The data required to be monitored and re- 
corded for the intensive test sites are 
identified in section 5.2 for each LACIE 
subsystem. {Required by CAS; Category 3; 
Implementation Responsibility; CAMS/YES/ 
CAS/DAPTS . ) 


C. The major source of error for each subsystem 
will be identified. The data obtained will 
be analyzed and a correspondence will be set 
up between the relevant aspects of the situa- 
tion, and will be formulated into mathematical 
models. The models will be exercised and 
compared with the ground reference data for 
verification of the model. Also, simulated 
data will be processed to provide a more 
controlled evaluation of the mathematical 
models. {Required by CAS; Category 3; Imple- 
mentation Responsibility; CAS /LAC IE AS VB for 
model development and GDSD for computers.) 

D. The technique and procedures required for the 

operational implementation of the CAS accuracy 
assessments will be developed, documented, and 
tested prior to the beginning of the LACIE 
full-up system. {Required by CAS; Category 3; 
Implementation Responsibility; CAS /LAC IE- AS VB 
for development and GDSD for computers for 
testing.) .-w; ■■ 


2.1.3 Design philosophy .- The accuracy assessment system 

of the CAS will be designed in a modular form to 
insure flexibility for modification of the sub- 
system without major subsystem impact. The opera- 
tional mode of the accuracy assessment system is 
required to be interactive. (Required by CAS; 
Category 1 ; Implementation Responsibility; ISSRS . ) 
That is, the user shall be able to address informa- 
tion for change and storage or retrieval, respond- 
ing only to user input directive. Information 
security shall be maintained to prohibit unauthor- 
ized user access. (Required by CAS; Category 2; 
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Implementation Responsibility: ISSRS.) The design 

should allow for data retrieval of TBD accuracy 
parameters on magnetic tape, compatible with the 
PDF 11/45 for offline processing and analysis. 
(Required by CAS; Category 3; Implementation 
Responsibility: ISSRS.) 

CAS accuracy assessment operation .- The CAS accur> 
acy assessment operation is as follows. 

A. The CAS shall insure that each subsystem moni- 
tors and records the parameters necessary to 
provide an assessment of the reliability and 
accuracy of the area, yield, and production 
estimates. The parameters required for the 
assessment are listed in section 5.2. Addi- 
tional parameters are TBD. (Required by CAS; 
Category 3; Implementation Responsibility: 

CAS /LAC IE- AS VB. ) These data will be processed 
and analyzed via the LACIE error model, and 
an estimate of the accuracy and reliability 
will be provided with all LACIE outputs. (Re- 
quired by LACIE PO; Category 3; Implementation 
Responsibility: CAS/LAC IE- ASVB for error model 

and EOD for computer support.) 

B. Any discrepancies in the LACIE area* yield, and 

production reports, identified by the USDA eval- 
uation of the information contained in these 
reports, will be investigated by the CAS. If 
the source of the discrepancy is determined to 
be within the AES, the CAS will analyze the 
causes and report to the AES and Quality Assur- 
ance Managers, and make recommendations to the 
LACIE PO. (Required by LACIE PO; Category 3; 
implementation Responsibility: CAS/LACIE-ASVB . ) 


Interim System 
Not applicable. 


SECTION 5.0 
INPUT REQUIREMENTS 

Inputs required by cAS from the other LAC IE func- 
tional elements are defined in the following sub- 
paragraphs . 


CROP ASSESSMENT 


Full -Up System 


DAPTS . - The following requirements are applicable 
to DAPTS . 


A. Landsat data requirements 

1. Landsat mosaics (Category 1; Implementation 
Responsibility: DAPTS) . Uncontrolled Land- 

sat-2 mosaics of MSS-5 for "green phase" of 
wheat growth stage a 1:1,000,000 scale of 
the Phase II LAC IE regions are required 60 
days prior to the start of acquisition of 
Landsat data for Phase II. Full frame Land- 
sat-2 color IR transparencies of the eight 
LAC IE countries. 

B. Field data requirements 

• • i ' / ■" ■ ' 

Not applicable. 

C. Historical agricultural data requirements 

1 . Historical Agricultural Statistics (Category 
1 ; Implementation Responsibility: DAPTS) . 

Total area, total agricultural area, wheat 
Urea (planted and harvested) , yield, and 
production data for the smallest reporting 
political subdivision for each LAC IE country 
for the last 15 years (if available) are 
required. These data are required on com- 
puter compatible magnetic tape, one tape 
per country per year, updated on an annual 
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basis. Delivery date for U.S. is ASAP, 

Delivery of other LAG IE countries* data 
is required by 11/1/75. Specific data 
requirements and format are described in 
NASA/USDA I CD, VOl II. 

2. Overlap regions (Category 1; Implementa- 
tion Responsibility: DAPTS) , Map overlays 

for LAC IE site location maps of 1:1, 000,000 
showing the winter/spring wheat overlap 
regions for the U.S . , USSR, and Peoples 
Republic of China (PRC) are required. These 
overlays will be reviewed annually and up- 
dated as required. The criterion for an 
update is whenever overlap boundaries change. 
These overlays are required ASAP for the U.S. 
The overlays for the USSR and PRC are re- 
quired by August 15, 1975. One copy of each 
overlay is required. 

3. Boundaries of political subdivisions (Cate- 
gory 1 ? Implementation Responsibility: DAPTS). 

Four copies of maps of 1:5, 000,000 scale or 
larger of each LACIE country delineating 

the boundaries of the smallest political 
subdivisions, are required. The maps must 
be of known projection. The maps shall 
cover each country in detail at least as 
fine as the data presented in 5. 1.1,1 C.l. 

The smallest political subdivisions for 
acreage aggregation are as follows: 

Country Political Subdivision 

Argentina 
Australia 
Brazil 
Canada 

India 
PRC 

U.S. 

USSR 

These maps are required as specified in 
paragraph 5.1. 1.1 C.l. The maps will be 


Part id o 
Divisions 
Municipality 
Mixture of divisions 
and subdivisions 
District 
Provinces 
Crop Reporting 
District 
Oblast 
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updated annually, when more detailed data 
become available, or when boundary changes 
occur . 

Cropping practices {Category 1; Implementa- 
tion Responsibility: DAPTS) . Cropping pra 

tices reports (ancillary summaries) arc 
required for each stratum identified in 
paragraph 5.1. 1.1 C.3. The reports pro- 
duced for YES are, acceptable. 

Crop calendars (Category 1; Implementation 
Responsibility: DAPTS) . One copy of mean 

historical crop calendars based on last 
15 years, if available, for each acreage 
stratum identified in paragraph 5,1.1. 1 C.3 
is required. These crop calendars will be 
used in determining the acquisition windows 
for Landsat* The calendars will be updated 
annually. 

Agricultural reports (Category 1; Implemen- 
tation Responsibility: DAPTS) . USDA re- 

ports containing current information on 
wheat area, yield, and production in all 
LAC IE countries are required. Reports 
published by LACIE foreign countries are 
also acceptable. One copy of the following 
reports is required: 

a. Annual summary of area, yield, and pro- 
duction of wheat for each LACIE country 

b. Foreign agriculture circular - grains 
(FAS) quarterly. 

c. Foreign agriculture (FAS) - weekly,-, 

d. Wheat situation (ERS/SRS) - Quarterly. 

e. Foreign agricultural attache reports - 
monthly. 

f. World agricultural and trade (FAS) - 



g. U.S. State publication in cooperation 
with SRS giving area, yield, and pro- 
duction at the country level, yearly. 
Required for all states? containing 
sample segments. 


5. 1.1. 2 CAMS . - The following information applies to the 

classification and mensuration subsystem. 


5. 1.1. 2.1 Electronic: 

A. Ready-access electronic outputs for sample seg- 
ments (Category 1? Implementation Responsibility: 
CAMS) . The following parameters shall be stored 
on magnetic tape for each classification run. 

For the recognition segment: 

1 . Sample segment number 

2 . DPR number 

3 . Run 1 0 

4. Bhattacharyya separability 

a. All channels 

b. Channel subset used 

5. External statistics tape number 

6. Number of recognition segment subclasses 

7. Number of merged image fields 

8. Number of pixels in D/0 fields 

9. Number of pixels in D/U fields 

10. Date of classification 

11. Number of clustering runs 

12. Number of chaining runs 

13. Number of acquisitions used for classifi- 
cation 
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14 . 

15 . 

16 . 

17 . 

18 , 

19 . 

20 . 
21 . 


For 

22 . 

23 . 

24 . 

25 . 

26 . 

27 . 

28 . 


Channels used in classification 

Current biological windows j 

Segment type identifier (spring/winter) 

Sample segment use indicator (training 
or not training) - ■ 

Dates of acquisition on merged image 

Segment number, segment type indicator, 
and acquisition dates for each training 
segment lu 

Threshold and a priori values used in 
classification (by category) 

Subclass classification results 

a. Subclass name 

b. Statistics manipulation flags 

c . Pixels classified into subclass 

d. Pixels threshold from subclass 

' !• ' 

each field in segment: 

Field name 
Subclass name 
Field type 
Field population 
Number of subclasses 
Name of each subclass 

Mean level adjustment. Sun angle correction 
flags for that (sub) class 



X 



29. Pixels classified into that subclass 

30, Pixels threshold from that subclass 

This tape shall be stored by ISRRS in the 
physical library for use by CAMS and CAS. 

B . The analyst evaluation of the recognition seg- 
- ' ment shall be manually passed to CAS and stored 
in the physical library by ISRRS. The follow- 
ing eva luat ion j codes shall be used: 

Code 01 s Not machine processed - clouds* 

haze, snow, etc. Means that 
the segment cannot be processed 
through the system because clouds, 
haze, etc., make interpretation 
and analysis impossible. 

Code 02: Not machine processed - confusion 

crops or other interpretation 
problems . 

This code should be used when a 
segment cannot be processed be- 
cause of interpretation difficul- 
ties, especially when confusion 
between wheat/small grains and 
other crops is such that a wheat/ 
small grains estimate cannot be 
determined. The rules for such 
a decision are to be negotiated 
between CAMS and CAS and included 
in the CAMS Detailed Procedures. 

Code 03: Bad data - due to technical prob- 

lems, not reordered. 

In this case the segment cannot 
- be processed due to tec hnical 
problems arising from unsatisfac- 
tory histogram, excessive scan- 
line drop, etc. If the segment 
is not reordered, this code is 
used. ■ . ■ 
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NOTE: If the segment is re- 

V7 ordered, no code (should 

be listed and no data 
sheet should be passed 
to CAS since this segment 
will, again be sent through 
the CAMS system for eval- 
uation. Any segment that 
cannot be processed due 
to clouds, etc., or tech- 
nical problems, should be 
■ passed as 01 or 03 . 

Code 05: Not machine processed - dormancy. 

In I eases where recognition is a 
problem due to the crop being in 
a state of dormancy this code is 
used. 

Code 07: Not machine processed - preemer- 

gence. 

In cases where the acquisition 
is prior to the criteria estab- 
lished for fall wheat recognition 
(TBD) this code is used. 

Code 09: Not machine processed - multiple 

acquisitions. 

Code 09 was developed to take 
care of the problem of processing 
multiple acquisitions of a segment 
at the same time. When multiple 
acquisitions are available at one 
time, only one segment, which is 
djetermined to be the better ac- 
quisition for interpretation and 
analysis by the CAMS analyst, is j 
selected for complete processing. 
Other acquisitions are listed as 
Code 09 to indicate that they had 
been reviewed but were not proc- 
essed through the system. This 
code enables CAS to review the 
segment results and account for 
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each acquisition and how it was 
J ';, > 1 evaluated by CAMS. 

Code 10: Unsatisfactory - unsatisfactory 

results for segment. 

This code is to be used for any 
acquisition that processed through 
the system and, based on CAMS eval- 
uation procedures, designated un- 
satisfactory. 

Code 12: Unsatisfactory - no significant 

change. 

This code is used when the new 
acquisition is evaluated to have 
no significant change from the 
previous unsatisfactory evalua- 
tion for the segment. 

Code 14: Unsatisfactory - rework, reeval- 

uated segment. 

This code is used when a segment 
which was previously passed to 
CAS is reworked. 

Code 18: Unsatisfactory - machine proc- 

essed multitemporal analysis. 

This code is used when more than 
one acquisition date is used to 
produce an unsatisfactory pro- 
portion estimate. 

NOTE: All acquisition dates used 

in processing should be 
listed on the CAMS Evalu- 
ation Form . 

Code 20: Marginal — marginal results for 

segment. 

This code is to be used for any 
acquisition that processed through 
the system and, based on CAMS eval- 
uation procedures, designated 
marginal. 
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Code 22: Marginal - no significant change. 

T^iis code is to be used when the 
new acquisition is evaluated to 
have no significant change from 
the previous marginal evalu£ition 
for the segment. 

Code 24: Marginal - rework, reevaluated 

segment. 

This code is used when a segment 
which was previously passed to 
CAS is reworked. j 

Code 28: Marginal - machine processed 

multitemporal analysis. 

This code is used when more than 
one acquisition date is used to 
produce a marginal proportion 
estimate. . j 

. NOTE: All acquisition dates used 

in processing should be 
listed on the CAMS Eval- 
uation Form. 

Code 30: Satisfactory - satisfactory re- 

sults for segment. 

This code is to be used for any 
acquisition that processed through 
the system and, based on CAMS eval 
nation procedures, designated sat- 
isfactory. 

Code 32 : Satisfactory - no significant 

change. 

This code is to be used when the 
hew acquisition is evaluated to 
have no significant change from 
the previous satisfactory eval- 
uation for the segment. 


Code 34: Satisfactory - rework, reevalu- 

ated segment. 

This code is used when a segment 
which was previously passed to 
CAS is reworked.: 

. ' , j . 

Code 36: Satisfactory - less than 5 % man- 

ually (hand) counted. 

This code is to be used for any | 
segment in which the proportion 1 
estimate is manually counted 
rather than machine processed. 

NOTE: This category would not 

be used if the segment was 
a rework segment. Code 34 
should be used. 

Segments in an agricul- 
tural area that have a 
055 proportion estimate 
are to be designated Code 
36. 

Code 38: Satisfactory - machine processed 

multitemporal analysis. 

This code is used when more than 
one acquisition date is used to 
produce a satisfactory proportion 
estimate. 

Code 40: Segment is totally nonagricultural . 

This code is used when the segment 
is evaluated as having no agri- 
culture at all, i.e. , no discern- 
ible field patterns. 

NOTE: Segments in an agricul- 

tural area that have a 
0 ?5 proportion estimate 
are to be designated 
Code 36. ...V; 
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5. 1.1,3 YES .- The following information pertains to the 

yield estimation subsystem, 

5.1. 1.3.1 Electronic: 

A. Meteorological data . (Required by CAS: Cate- 
gory 1; Imp 1 emen ta t ion Responsibility: YES/ 

NOAA) . Current standard meteorological data 
is required for use by the CAS analysis in 
accounting for episodal weather events in 
crop aggregations and for analysis of crop pro- 
duction. 


These records should include, as a minimum, 
monthly average of daily maximum and minimum 
temperatures and precipitation amounts for the 
periods of wheat yield records in that area. 
Where available, the record may contain more 
temporal detail and other parameters. Examples 
of parameters that may be available are average 
daily maximum temperature, average daily min- 
imum temperature, monthly mean rainfall, daily 
rainfall reports, snowcover, drought index, 
and solar radiation. 


| 

Meteorological stations from which data are 
required are all those as available in each 
smallest political subdivision containing one 
or more LAC IE sample segments. It is antici- 
pated that up to 5000 meteorological stations 
may be involved. These records are required 
in either published volumes or on computer- 
compatible magnetic tape. 


Location of meteorological stations latitude 
and longitude in degrees and minutes. Yield 
strata descriptors. Yield meteorological sta- 
tions correlated with strata. 


Once monthly NOAA will deliver to NASA-JSC- 
NQAA/YES the daily transmission plus a monthly- 
summary of the WMO data received and trans- 
mitted daily. This is required on magnetic 
tape in the formats of Appendixes F and G of 
Vol . III. 
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B. Yield coefficients (Category 1; Implementation 

Responsibility: YES) . Provide yield coeffi- 

cients for each strata and each truncation for 
spring and winter wheat for all LAC IE countries 
using the current CCEA-1 yield model prior to 
model operations. Provide MAP factors using 
Feyerherm (KSU) yield model for natural strata 
in Kansas and North Dakota in the U.S. Great 
Plains and for natural strata in Tseli nograd 
and Kurgan oblasts in the USSR for use during 
Phase III, for natural strata in all of the 
LAC IE U.S. Great Plains area for use during 
Transition. 

C. Yield values (Category 1; Implementation Re- 
sponsibility: YES) . Provide monthly spring 

and winter wheat yield values and standard 
statistics for each stratum (natural or polit- 
ical as appropriate) using both the CCEA-1 
and the Feyerherm yield models for areas spec- 
ified above. The standard statistics will show 
the relative contribution of historic and cur- 
rent meteorological data. These data are to 

be provided as defined in NOAA/NASA/USDA ICD 
(LAC IE C00710) . 

D. Terminal (Category 1; Implementation Responsi- 
bility: YES for the Page Bldg, interface to 

the phone lines, FSO for phone lines and ter- 
minal at JSC). A read-only terminal for persuing 
the YES data base and predicted yield values 
shall be provided at JSC connected to the YES 
prediction computer in Washington, D.C. and 
Columbia, Md. Data rates shall be low enough 

to permit use of acoustic coupler. Use shall 
be 2 hours per day, 7 days per week. YES shall 
provide personnel to operate JSC terminal. YES 
shall determine where the terminal shall be 
located. 



5.1.1 .3.2 Nonelectronic: 

A. Crop calendars (Category 1; Implementation Re- 
sponsibility: YES). Crop calendars and real- 

time adjustments to crop calendars by strata 
provided in season approximately once per two 
weeks as defined in the NOAA-NAS A- USDA ICD. 


$ 

tar 


B, Meteorological summary (Category 1? Implemen- 
tation Responsibility: YES). Tabulations, 

overlay maps, and narratives will be provided 
for an overall view of the prevailing meteoro- 
logical conditions and annotations, whether 
normal, above normal, or below normal, and to 
what extent. Flags will be provided to CAS 
for aggregate consider at ion on the amount of 
stratum, zone, region, or country which has 
experienced abnormal weather (unseasonably 
high or low temperatures, precipitation, 

- storms, etc.). Delivery requirements are de- 
. fined in the NOAA-NASA-USDA I CD. 

C. Yield strata boundaries (Category 1; Implemen- 
tation Responsibility: YES) . Boundaries of 

yield strata in all LAC IE countries drawn on 

f rom 1 : 250 , 000 to 1:10** ONC maps as appropri- 
ate. Annual with monthly corrections, if 
required. 


5. 1.1. 4 CAS . - The following information pertains to the 

crop assessment subsystem. 


5. 1.1. 4.1 Sample strategy: 

A. Selection of sample strategy for use in Phase 
I (Category 1; Implementation Responsibility: 
CAS/LACIE-ASVB) . See Appendix C. 

B. Select sample segments (Category 1; Implemen- 
tation Responsibility: CAS/LACIE-ASVB). Al- 

location of sample segments with definition 
of center coordinates (latitude and longitude 
in degrees and minutes) and number /stratum 
and ID for each acreage stratum. Each seg- 
ment will be identified as spring or winter 
wheat. Sample segment ID and allocation for 
LAC IE .countries;. ; 




Country 

Segments 

Allocated ID numbers 

j 

Brazil 

47 

001-099 

Argentina 
U.S. (New Sam- 

165 

500-799 

pling Strategy) 

164 

800-999 

United States 

601 

1000-1999 

India 

626 

2000-2999 

Canada 

283 

3000-3499 

Australia 

; 257! 

4000-4499 

China 

810 

5000-6499 

USSR (New Sam- 



pling Strategy) 

80 

6500-6999 

USSR 

1947 

7000-9499 


C. Pseudo substrata (Category 1; Implementation 

Responsibility: CAS/LACIE-ASVB) . Number of 

5x6 nm rectangles per substratum minus excluded 
nonagricultural areas, 

D. Substratum ratios (Category 1; Implementation 

Responsibility: CAS/LACIE-ASVB), Ratio of 

true substratum area to pseudo substratum area. 

E. Test sample strategy (Category 1; Implementa- 
tion Responsibility: CAS/LACIE-ASVB) . The 

sample strategy will be tested prior to im- 
plementation in the AES, 

F. Subdivision definition (Category 1; Implemen- 
tation Responsibility: CAS/LACIE-ASVB). Def- 

inition of up to 4800 substrata, 400 strata, 

150 zones and 50 regions with boundaries and 

id. 

G. Neighbor strata (Category 1; Implementation 

Responsibility: CAS/LACIE-ASVB) . List of 

nearest neighbor strata for each area stratum 
and substratum. 

H. Historical wheat acreage (Category 2; Imple- 
mentation Responsibility: CAS/LACIE-ASVB) . 

Historical wheat area and total area for each 
area substratum in each LAC IE country for 
inclusion in the monthly report for comparison. 
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I. Historical cloud cover (Category 1; Implementa- 
tion Responsibility: CAS/ASVB) . Historical 

cloud cover statistics of wheat growing areas 
(^2000 acres wheat) in LAC IE countries. Month- 
ly unconditional probabilities are needed for 

each acreage stratum of the LACIE countries. \ 

An overall assessment of the probability of 
acquiring the stage 1, 2, 3, 4; 1 , 2, 3; 1 , | 

3 , 4; 2, 3, 4; 2, 3, 4; etc. for each stratum f 

is required . 

ii 

J. Index of sample segments (Category 1; Implemen- 
tation Responsibility: CAS/LAC IE-ASVB ) . Index 1 

substrata to 400 acreage strata, index of sam- i 

pie segments to 4800 substrata, index of area f 

strata to 150 zones, index of zones to 50 j 

regions, and index of regions to 8 countries. 

.. 

•• j " ■ . • ■] 

\ ■ • . . \ jj 

5. 1.1. 5 ISRRS . - The following information applies to the 

information storage, retrieval, and reformatting 
subsystem. 

A. The ISRRS shall supply to CAS sample segment 

classification reformatted from the results \ 

tape generated by CAMS at 1-day intervals. ; 

ISRRS shall also merge the daily tapes into 

one master tape for delivery to CAS. The 
nonelectronic requirements of section 5.0 
and 6.0 require library- type storage by the 
ISRRS. (Category 1; Implementation Responsi- 
bility: ISRRS). 

B. Sample segment status matrix (Category 1; 

Implementation Responsibility: ISRRS.) 

Sample segment status report (in tabular for- 
mat) required daily. Status of 4800 sample 
segments shown as date Landsat data acquired, 

Wheat biological stage, acquired - not clas- 
sified - acquired - classified suitable, ac- 
quired - classified marginal, acquired - 
classified unsuitable, acquired - backlogged, 

not acquired. Computer capability to sort , | 

segment status by country, region, and zone | 

and by classification - suitable, marginal 
and unsuitable is required in Phase II and 
Phase III. Sort capability is Category 2. 
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5. 1.1. 6 


SPE .— 


5. 1.1.7 IJE.- (Category 3; Implementation Responsibility: 

IE/USDA) . The type, content, format, and fre- 
quency of information required from the LACIE 
AES. 


5. 1.1, 8 Research .- (Category 1? Implementation Responsi- 

b i 1 i ty : LACIE-RTEB) , All reports concerning 

the research specified in section 10.0. 


5 .1.1 .9 Test and evaluation .- (Category 1 ; Implementation 
Res pon s ib i 1 ity : LACIE-RTEB). LACIE test and 

evaluation reports as they are available. These 
reports contain the results of the efforts in 
the LACIE test and evaluation of intensive test 
sites, ASCS test sites, etc. 


5.1.2 Interim Systems 

Not applicable. 


5.2 ACCURACY ASSESSMENT 


Inputs required by the CAS for the system accuracy 
assessment from the other LACIE functional elements 
are defined in the following subparagraphs. 


5.2.1 Full-Up System 


5.2.1. 1 DAPTS.- The following information applies to the 

DAPTS. 

A. Landsat data requirements 

1. Landsat MSS calibration documentation 
(Category 1 : Implementation Responsi- 
bility: DAPTS) . Documentation is re- 

quired on the GSFC calibration procedures 
for LACIE data; in particular, the pro- 
cedure for replacement of data due to 
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out-of-sync conditions and the relation- 
ship of the radiometric error versus the 
siqnal strength of spectral energy level. 

2. Land sat MSS registration documentation 

(Category 1 : Implementation Responsi- 
bility: DAPTS) . Documentation is re- 

quired on the GSFC registration procedures 
for LACIE; in particular, the definitive 
procedures used in both the automatic and 
manual modes, the error analysis study 
supporting the registration accuracy re- 
quirements and a further definition of the 
origin of the header record information 
pertaining to registration. 

3. Registration accuracy report (Category 1; 

Implementation Responsibility: DAPTS) . 

The DAPTS is required to determine the 
GSFC registration accuracy on a periodic 
basis for a number of the LACIE segments 
needed to make a valid statistical infer- 
ence of the registration accuracy. A 
semiannual report is required which pre- 
sents the results of the registration 
accuracy analysis. 

B. Field data requirements 

1 . Ground truth (Required by CAS; Category 1 ; 
Implementation Responsibility: DAPTS/ 

SSAD-FSO/USDA) . 

DAPTS will provide the following date for each 

LACIE Intensive Test Site. 


A. One copy of a 1:24,000 scale rectified B&W 
photomosaic of each ITS. The photomosaic is 
to be made from high altitude aerial photog- 
raphy acquired once per year, just before 
wheat harvest. 

B. One copy of a 1:24,000 scale transparent over- 
lay registered to the photomosaic of (a) above 
and delineating the boundaries of each field 
in the test site. Each field will be numbered 
and a tabular listing provided containing the 
following data: 
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1. Field number. 

2. Field acreage. 

3. Crop and variety being grown. 

4. Is field irrigated? If so, how? 

5. Is field fertilized? If so, how? 

6. Planting date. 

These data are to be acquired once per crop year, 
after spring planting and before wheat harvest. 

C. One copy of a 1:24,000 scale field boundary 
map registered to the photomosaic of A above 
and delineating the boundaries of only those 
fields containing fall-planted crops in each 
Intensive Test Site in Texas, Kansas, Indiana, 
and Washington. Each field will be numbered 
and a tabular listing provided containing the 
information of item B above. These data are 
to be acquired once per crop year, after fall 
planting and before the beginning of dormancy. 

D. One copy of periodic observation data ac- 
quired at 18-day intervals from approximately 
50 fields in each Intensive Test Site. Fields 
selected for observations must contain both 
wheat and other crops grown in the area . 

Fields selected must be 40 acres or larger in 
size. Adjacent fields planted in the same 
crop and divided by fences or farm roads may 
be grouped to obtain a 40 acre or larger area, 
if necessary. Data are required from the end 
of dormancy for fall planted crops or spring 
crop plantings until harvest. Data are to be 
acquired concurrent with Landsat-2 overpasses. 
The following data are required in tabular form 

1 . Growth stage 

. 2. Percent ground cover 

3 S Flant height 

4. Surface moisture 
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5. Weed growth 

l ■ ’ 

6. ) Field operations 

. i : ; • 

7 . Growth/yield detractants 

8. Stand quality rating 

9. Vertical color photos 

- t • * . • ■. ■ 

: . •• j - ' 

10. Observation date 

11. General comments on field and test site 
conditions 

C. Historical agricultural data requirements. 
Same as 5.1.1.1 C. 

D. Real-time meteorological data requirements. 
Not applicable. 

E. Historical meteorological data requirements. 
Not applicable. 


5. 2. 1.2 CAMS - classification summary report .- The follow- 

ing items are required from the CAMS summary 
report: 

A. AI misidentif ication errors (Category 3; Im- 
plementation Responsibility: CAMS). An es- 

timate of the misidentif ication errors due to 
AI, per training segment and stratum, 

B. Cluster procedure identification (Category 1; 

Implementation Responsibility: CAMS) . Docu- 

mentation of whether clustering was used or 
not for each segment processed. Total classes 
available and the number of subclasses obtained 
from clustering and/or used in the classifica- 
tion for each class will be recorded. 


C. Signature extension parameters (Category 1; 
Implementation Responsibility: CAMS) . Spec 

if y the distance, direction, time-phase (if 
different) , and the Sun angle and mean level 
corrections (if applied) for the segment to 
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which siqnaturc extension was carried out. 
Also, specify the segment ID numbers to which, 
and from which, the signature extension was 
done. 


D. Classification parameters 

1. The number of channels employed in each 

classif station; specifically the bands 
for each temporal period selected. (Cat- 
egory 1; Implementation Responsibility: 
CAMS). ■ ^ 

2. The a priori probabilities used in each 
classification , if unequal. (Category 

1; Implementation Responsibility: CAMS). 

3. Classification accuracies for the training 

fields data sets for all segments for 
which A! data is obtained. (Category 2; 
Implementation Responsibility: CAMS ) . 

4. Interclass and intraclass Bhattacharrya 
distance associated with the features 
for each segment processed. (Category 

1 ; Implementation Responsibility: CAMS) . 

5. Classification bias for each sample seg- 
ment. (Commission-omission error). (Cat- 
egory 1; Implementation Responsibility: 
CAMS) . 



Classification results for each intensive 
study site and the AI fields for the site 
Also, the identification (in terms of 
coordinates) of each AI field. (Category 


1; Implementation Responsibility: 


CAMS) . 



5. 2. 1.3 YES.- The following information is applicable 
to YES. • 

A. Yield accuracy (Category 1 ; Implementation 
Responsibility: YES) . The YES will provide 

yield estimates for each yield strata, asso- 
ciated yield contribution of each coefficient, 
prediction error for each strata estimate of 
yield, and the WMO number of each weather sta- 
tion used for each yield stratum and the * 


relative weight given to the weather from each 
weather station in making the yield estimate 
for that stratum. These data will be provided 
monthly for LAC IE areas specified using yield 
models specified for those areas. 

B. Interstrata correlation (Category 1; Implemen- 
tation Responsibility: YES) . Provides an 

estimate of the interstrata yield correlation 
statistics . 


CAS . - The following information pertains to CAS. 

A. Aggregation parameters (Category 1; Implemen- 
tation Responsibility: CAS/LAC IE- ASVB) . The 

CAS will provide for each stratum, region, 
zone, or country, aggregated, the following 
information: 

■ r ■ "... . •• . ' -. ■' • 

1 . Number of sample segments expected and 
used per stratum/substratum. 

2. Number of passes and which biological 
phases were used for each sample segment. 

3. Historical data wheat area, estimates for 
each stratum, region, zone, and country, 
and the accuracy of these estimates. 

4. Crop inventory estimates (area yield and 
, production) in percentage of pixels by 

sample segment, stratum, region, zone 
and/or country. 

5. Estimate of the variance in the wheat 
area estimates for each stratum, region, 
zone, etc. 

6. The relationship obtained by comparing 
an estimate with a corresponding histor- 

i: ical estimate. 

B. Classification and AI training-field accura- 
cies compared on a pixel- by-pixel basis for 
all intensive study site areas within a 5x6 
mile segment as compared to ground truth 
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data tapes. (Category 1? Implementation 
Responsibility: C AS/ LAC I E- A S VB ) . 


5. 2. 1.5 ISjRRS . - (Category 2; Implementation Responsibility: 
ISiRRS) . The ISRRS will provide storage and re- 
trieval and provide to CAS on a demand basis the 
input physical data requirements identified in 
section 5.2. 

; ■ r 

l 

5.2.1 .6 SPE. - None identified. 


5.2. 1.7 IJ2 - LACIE Information Evaluation Reports .- (Cate- 
gory Tj Implementation Responsibilities : IE) . 

The information evaluation will provide the CAS 
with LACIE output evaluation 30 days after re- 
ceipt of the LACIE reports. In addition, any IE 
accuracy assessment requirements shall be iden- 
tified to the CAS. 


5. 2. 1.8 Research . - Research efforts are required for a 

quantitative assessment of each technique to be 
developed and implemented in the LACIE system. 
Listed in section 10.2 are areas in which inves 
tigations are required for the assessment of 
LACIE full-up system. 


5. 2.1. 9 Test and evaluation .- The following information 

pertains to test and evaluation. 

A. Testing documentation (Category 1; Implemen- 
tation Responsibility: LACIE- RT&EB) . The 

results of all subsystem testing will be 
documented and provided to CAS. Any interim 
results should be provided as available. 

B, Error Model Evaluation (Category 1; Implemen- 

tation Responsibility: LACIE-RTSEB) . Test 

and evaluation of all error models developed 
and/or utilized by the CAS. 
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C. CITARS results (Category 1; Implementation 
Responsibility: LACIE-RT&F.B) * The results 

of the CITARS segment analysis, and the re- 
sults of analysis of variance, shall be 
suppLied to CAS-AA. 


Interim System 
Not applicable. 




SECTION 6.0 


OUTPUT PRODUCTS 

■ ; ;■ ■■ 

Outputs from CAS which will be provided to the 
other LAC IE functional elements are defined in 
the following subparagraphs. 

6.1 

CROP ASSESSMENT 

6.1.1 

Full-Up System 

6 . 1 . 1 . 1 

DAPTS.- The following information applies to 


DAPTS . 


A. List of sample segment numbers and coordinate^ 

(Computer Card Coding Sheets). (Required by: 
DAPTS; Category 1; Implementation Responsi- 
bility: CAS/LAC IE-ASVB) . Implement the LAC IE 

sampling strategy and select and provide to 
DAPTS the geographic center coordinates (lat- 
itude and longitude) of 4800 numbered sample 
segments. The coordinates will be specified 
in degrees and minutes (to the nearest minute) 
of latitude and longitude. Selected sites 
will have been judged against all system con- 
straints (see section 4.1.1) and found accept- 
able. The data will be supplied to DAPTS 
through entry on computer card coding forms 

in the format specified in the JSC card format 
documentation. 

B. GSFC data order (computer card coding sheets) . 

(Required by: DAPTS; Category 1; Implementa- 
tion Responsibility: CAS/LAC IE-ASVB) . The 

CAS will prepare computer coding sheets con- 
taining all sample segment data needed to 
activate the GSFC acquisition and preprocessing 
of ERTS data. These coding sheets will be pre- 
pared in the format specified by the JSC card 
format documentation and will contain such 
information as the segment number, location, 
training site designation, definition of bio- 
logical windows, and color code information 
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for the PFC . Inputs will be obtained from CAMS, 
YES, and other subsystems as appropriate. Com- 
pleted forms will be provided to DARTS. 

CAMS.- The following information is required by 
CAMS . 

A. Sample segment location ( Required by: CAMS; 

Category 1; Implementation Responsibility: 
CAMS/LACIE-ASVB) . Sample segment center co- 
ordinates - latitude and longitude in degrees 
and minutes. The nominal location of all 
sample segments shall be indicated on trans- 
parent overlays (three copies) suitable for 
registration upon USAF ONC's (Operational 
Navigational Charts) or I.andsat uncontrolled 
mosaics. These overlays shall indicate the 
achieved Landsat-2 ground tracks, LAC IE frame 
numbers, and LACIE overlap zones. 

B. Sample segment histograms (Required by: CAMS 

Category 1 ; Implementation Responsibility: 
CAS/LACIE-ASVB) . Histograms indicating the 
distribution of number of sample segments per 
unit area for spring and winter wheat regions 
of each country. 

C. Landsat acquisition rates (Required by CAMS; 
pategory 1; Implementation Responsibility: 
CAS/LACIE-ASVB) . Sample segment Landsat data 
acquisition rates for spring and winter wheat 
in segments per month by country. The indi- 
vidual segment numbers for each predicted ac- 
quisition date during the wheat phenological 
development stage. 

D. Flagged area output (Required by CAMS; Cate- 
gory 1; Implementation Responsibility: CAS/ 

LACIE-ASVB) . Sample segment classification 
that results in more than 20 percent change 
in the previous biophase percentage wheat 
area will be returned to CAMS for classifi- 
cation verification. 


... , ; . ... 


6. 1.1. 3 YES . - The following information is required by 

YES. 

A. Yield prediction and Production estimation 

feedback (Required by: YES; Category 1; 

Implementation Responsibility: CAS/LACIE- 

ASVB) . The CAS will provide to YES flagged 
outputs concerning yield and/or production 
estimation that varies M5 percent from the 
historical mean, or departing significantly 
from surrounding strata. 

B. Definition of strata for yield prediction 

(Required by: YES; Category 1; Implementa- 
tion Responsibility: CAS/LAC IE-ASVB) . The 

CAS will provide a definition of the strata 
for which yield forecasts must be supplied 
to CAS. 

C. Accuracy assessment (Required by: YES; 

Category 1; Implementation Responsibility: 

CAS LACIE-ASVB) . Provide accuracy assessment 
plans and procedures that specify those tasks 
for which YES is responsible. 


6.1. 1*4 CAS .- The following information is required by 

CAS. 

A. Area, yield, and production reports (Required 
by: CAS; Category 1; Implementation Responsi- 
bility: CAS/LAC IE-ASVB) . Area, yield, and 

production estimates with standard statistics 
for spring and winter wheat for each stratum, 
zone, region, and country in the LAC IE. The 
date, and report numbers are on each estimate. 
Stratum production will be stratum acreage 
times stratum yield. The units of the stand- 
ard reports for wheat area, yield, and pro- 
duction will be hectares quintals/hectare, 
and thousand metric tons, respectively. Ad- 
ditional reports for the U.S. and Canada will 
be prepared in acres, bushels/acre, and thou- 
sand bushels. The area reports at each level 
will contain the number of each biostage used 
to prepare the report. The lowest level re- 
port will contain the date of the acquisition 
of each segment (s) used to prepare the report 
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and whether it is training or recognition, 
and multi temporal or not. Room for 7 bio- 
stages of classification results must be pro- 
vided for and each report must list the years 
of historical data in the data base. See Ap- 
pendix A for details of the reports. These 
reports are considered speculative information. 

■ i 

B. Sample segment report (Required by: CAS? 

Category 1? Implementation Responsibility: 
CAS/LAC IE-ASVB) . Number and ID of aggregatable 
sample segments determined’ to be satisfactory, 
marginal, or unsatisfactory (by CAMS using 
the evaluation codes described in Section 
5.1.1.2.1 b) and percentage of sample segment 
pixels classified as wheat, other, unidenti- 
fiable, and threshold; estimated error, bio- 
phases, and acquisition date for each area 
substratum allocated for area aggregation are 
reported weekly. 


C. Satisfactory segment area estimate for each 

substratum (Required by: CAS; Category 1? 

Implementation Responsibility: CAS/LACIE- 

ASVB) . Spring and winter wheat area estimate, 
standard deviation, and percentage of mean 
based on 15 years for each stratum using 
satisfactory segments. Satisfactory segments 
are segments whose evaluation codes (5.1. 1.2.1 B) 
are between 30-39. 

D. Satisfactory plus marginal area estimate for 

each substratum (Required by: CAS? Category 1? 

Implementation Responsibility: CAS/LAC IE-ASVB) . 

Spring and winter wheat area estimate, standard 
deviation, and percentage of mean based on 15 
years for each stratum using satisfactory plus 
marginal segments. Marginal segments are those 
segments whose evaluation codes (5. 1.1. 2. IB) 
are between 20-29. , 

E. Nearest neighbors area estimate for each sub- 
stratum (Required by: CAS? Category 2; Im- 
plementation Responsibility: CAS/LAC IE-ASVB ) . 

Spring and winter wheat area estimate, standard 
deviation, and percentage of mean based on 15 
years for each substratum using nearest neigh- 
bors substratum. 
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F. Manual selection area estimate (Required by: 
CAS; Category 1; Implementation Responsibility 
CAS/LACIE-ASVB) . Spring and winter wheat area 
estimate, standard deviation, and percentage 
of mean based on 15 years for each stratum 
using manual selection of suitable segments. 

G. Manually deleted sample segments (Required 

by: CAS; Category 1; Implementation Respon- 
sibility: CAS/LACIE-ASVB) . ID's of sample 

segments manually deleted from area estima- 
tion and ID's of neighboring strata used for 
area estimation. 

H. PPS area strata (Required by: CAS; Category 

1; Implementation Responsibility: CAS/LACIE- 

ASVB) . Numbers and ID's of selected and non- 
selected PPS area strata for spring and winter 
wheat in 150 zones. 

I. PPS strata area estimates (Required by: CAS; 

Category 1; Implementation Responsibility: 
CAS/LACIE-ASVB). Spring and winter wheat 
estimated area, standard deviation, and per- 
centage of mean based on 1 5 years for each 
strata based on PPS substrata. 

J. Region and country area estimates (Required 

by: CAS; Category 1; Implementation Respon- 
sibility: CAS/LACIE-ASVB). Spring and winter 

wheat estimated area, standard deviation, and 
percentage of mean based on 1 5 years for each 
area region and country. 

K. Yield estimates (Required by: CAS; Category 

1; Implementation Responsibility: CAS/LACIE- 

ASVB) . Spring and winter wheat yield, yield 
variance, and percentage of mean yield based 
on 15 years for each area stratum, zone, 
region, and country in LACIE, with yield re- 
port date and number. Speculative data. 

L. Spring and winter wheat production (Required 

by: CAS; Category 1; Implementation Respon- 
sibility: CAS/LACIE-ASVB) . Spring and winter 

wheat production, production variance, and 
percentage of mean production based on 15 
years for each area stratum, zone, region, 
and country in LACIE. Speculative data. 
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M. Total wheat production (Required byi CASf 
Category 1; Implementation Responsibility! 
CAS/LAC I E-ASVB) . Total of spring and winter 
wheat production, standard deviation, per-* 
centage of mean production based on 15 years 
for each area stratum, zone, region, and 
country in LAC IE . Speculative data* 

N. Sampling strategy documentation (Required by: 
CAS; Category 1; Implementation Responsibility; 
CAS/LACIE-ASVB) . Documentation on the sampling 
strategies used for each country and the esti- 
mated sampling error for each strategy as a 
function of the input data. 


6. 1.1. 5 ISRRS .- Not applicable. 


6.1. 1.6 SPE .- (Required by: SPE; Category 2; Implementation 

Responsibility: CAS/LACIE-ASVB responsible for 

reporting and GDSD for software to track computer 
Usage times) . Monitor and record TBD throughput 
and resource information of CAS operations for a 
TBD period of time oh an as-requested basis. 


6.1*1. 7 IE.- (Required by: IE; Category 1; Implementation 

Responsibility: CAS/LACIE-ASVB) . The CAS will 

submit CAS Monthly Crop Reports (CMR) , CAS Un- 
scheduled Reports (CUR) , and CAS Annual Reports 
(CAR) to IE, Washington, DC. The contents, for- 
mat and schedule of these reports will be in 
accordance with Section 4.0 of the Crop Assessment 
Subsystem/Information Evaluation (CAS/IE) Inter- 
face Control Document (LACIE-CO 0709) . 


6. 1.1. 8 Research .- (Required by Research; Category 2* Im- 
plementation Responsibility! CAS/LACIE-ASVB). 
Computation of cloud cover over intensive test 
sites. 


6. 1*1. 9 Test and evaluation .- Not applicable. 
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6 . 1.2 


6.2 


6 . 2.1 


6 . 2 . 1.1 


6 . 2.1 .2 


6 . 2 . 1 . 3 


6 . 2.2 


Interim System 
Not applicable. 


ACCURACY ASSESSMENT 


Outputs from CAS accuracy assessment to be pro- 
vided to the LAC IE functional elements are de- 
fined in the following subparagraphs. 


Full~Up System 


Accuracy estimates .- (Required by: IE; Category 2; 

Implementation Responsibility: CAS/LAC IE-ASVB) . 

The accuracy assessment outputs will be included 
as part of the standard CAS outputs as required 
by the IE. The information to be included will 
be an estimate of the accuracy and reliability 
of the LACIE output. 


Discrepancy evaluation .- (Required by: IE; Category 

2; Implementation Responsibility: CAS/LAC IE-ASVB) . 

The CAS will investigate any discrepancies docu- 
mented in the periodic USDA evaluation. If the 
source of the discrepancy is determined to be 
within the AES, the CAS will analyze and report 
the causes and make recommendations to the AES 
and quality assurance managers. 


System testing .- (Required by: CAS; Category 4; 

Implementation Responsibility: DAPTS/CAMS/YES/CAS 

and ISRRS). A set of TBD test data will be supplied 
to DAPTS, CAMS, YES, CAS, and ISRRS. 


Interim Systems 
Not applicable. 


SECTION 7.0 
INTERFACE REQUIREMENTS 

\ . . . : . . • • ' ' 

The interface requirements of CAS will be identi- 
fied as the LACIE subsystem requirements docu- 
ments are baselined. Interface control documents 
will be generated 90 days after baselining the 
requirements. The current ICD requirements iden- 
tified are CAS-IE/USDA - output reports and feed- 
back from USDA. 
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SECTION 8.0 

OPERATIONAL REQUIREMENTS AFFECTING THE DESIGN 


8.1 


CROP ASSESSMENT 


8.1.1 Throughput Requirements (Reg 'd by: CAS ; Cat . 1 ; 

Imp I. Resp.: CAS/LAC 'IF.- ASVB ) 

There are 4800 sample segments classified four 
times per wheat growing season. Sample segment 
throughput requirements per country are TBD. 
Calculate the area, average yield, and production 
for 4800 substrata, 400 strata, 150 zones, 50 
regions, and 8 countries once each month. 


8.1.2 Response Requirements (Req'd by: CAS; Cat. 1; 

Impl . Resp.: CAS/LAC IE- AS VB ) 

Production of area, yield, and production reports 
monthly for at least eight countries requires 
interactive automatic data processing and computer 
accessible storage and retrieval of sample segment 
classification information. The outputs of area, 
yield and production data by stratum, zone, region, 
and country require approximately 1800 reports per 
month. See Appendix A for reports. It is esti- 
mated that this activity will require 8 hrs/day 
for 3 weeks and 16 hrs/day for 1 week each month. 


8.1.3 Reliability Requirements (Req'd by: CAS; Cat. 1 ; 

Impl. Resp. : CAS) 


8. 1.3.1 Data base .- The data base should be periodically 

recorded on magnetic tape for rapid data base re- 
covery to prevent extensive data loss requiring 
more than 2 hours to reconstruct. 


8.1.4 Security Requirements (Req'd by USDA; Cat. 1; 

Imple. Resp.: CAS/LACIE-ASVB) 

A LAC IE Security Plan shall be prepared by each 
organization designated with implementation 
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responsibility. The plan for each implementing 
organization shall define the specific measures 
that will be utilized by that organization to 
comply with the LACIE security requirements. The 
LACIE security requirements shall be defined by 
the US DA and will be forwarded to the implement- 
ing organizations upon receipt by the LACIE Proj- 
ect Manager. Each implementing organization 
shall submit their plan for approval to the LACIE 
Level III Change Board within 90 days after their 
receipt of the USDA requirements. 

8.1.5 Delivery Requirements (Req'd by: CAS; Cat. 1;! 

Impl. Resp. : CAS/LAC IE-ASVB ) 

The monthly crop assessment reports are transferred 
to USDA, Washington, D.C„, by registered mail each 
month. 


8.1.6 Quality Assurance Requirements (Req ! d by: LACIE- 

PO; Cat. 1 ; Impl, Resp.: CAS7lAC IE-ASVB) 

A LACIE Quality Assurance Plan is being prepared, 
as well as a separate Quality Assurance Procedures 
document. These documents are being prepared under 
the direction of the Quality Assurance Manager. 


8.1.7 Other Operational Requirements 

None . : : 

8.2 ACCURACY ASSESSMENT 


8.2.1 Throughput Requirements (Req’d by: CAS ; Cat 1; 

Impl. Resp.: ISRRS) 

The throughput requirements of the accuracy assess- 
ment are dependent upon the throughput requirements 
of other LACIE functional components. That is, as 
the number of segments processed per day or per 
week increases, the amount of data processing re- 
quired will correlatively increase, and vice versa.’ 
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8 . 2.2 


Response Requirements (Req'd by: CAS; Cat. 1; 

impl. Kesp. : ISRRS) 

The CAS will require one-day turnaround on error 
model runs. The CAS will also require one-day 
response for data retrieval from the ISRRS. 


8.2.3 Reliability Requirements (Req'd by: CAS; Cat 2; 
Impl. Resp. : ISRRS) 

The reliability requirements (up time) , of the 
LACIE system, for the CAS’ -must match those re- 
quired by the CAMS. 


8.2.4 Security Requirements (Req'd by: CAS; Cat. 1; 

Impl. Resp. : IeI 

The CAS security requirements are defined in the 
IE/CAS ICD . 


8.2.5 Delivery Requirements 

The TBD delivery requirements of and for CAS data 
is dependent upon the security requirements of 
the data being delivered. 

8.2.6 Quality Assurance Requirements 

A LACIE Quality Assurance Plan is being prepared, 
as well as a separate Quality Assurance Procedures 
document. These documents are being prepared under 
the direction of the Quality Assurance Manager. 
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SECTION 9.0 


VERIFICATION REQUIREMENTS 


9.1 CROP ASSESSMENT (Req'd by: CAS; Cat. 2; Impl. 

Resp. : CAS/LACIE-ASVBj 


The CAS shall prepare the subsystem portion of 
the LACIE Verification Plan and submit it for 
Level III approval 90 days after the Level IV 
Requirements Documents are baselined. The plan 
shall provide a complete definition of the veri- 
fication functions required to verify the opera- 
tion of the CAS portion of the LACIE system. Each 
portion of the software package shall be verified 
prior to integration into the operational system. 


9.2 ACCURACY ASSESSMENT 


Each organization designated with implementation 
responsibility shall prepare a LACIE Verification 
I>lan, including a complete definition of the veri- 
fication functions proposed for verification of 
the portion of LACIE for which they are respon- 
sible. Each organization shall submit their plan 
for approval to the LACIE Level III change board 
within 90 days after the requirements documents 
are baselined. As a minimum, the verification 
plan shall include the following related to the 
CAS subsystem: 

A. Program verification . (Required by: CAS; 

Category 1; Implementation Responsibility: 
DSAD) . DSAD will provide to CAS current 
source listings and flow diagrams of all 
programs implemented for LACIE. 

B. System testing . (Required by: CAS; Category 

2; Implementation Responsibility: DAPTS/CAMS/ 

YES/CAS/ISRRS) . The CAS will provide a set 

of test data to each of the following sub- 
systems: DAPTS, CAMS, YES, CAS, and ISRRS . 

Each of these subsystems will use their stand- 
ard operating procedure to input this test 
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data into the LACIE systems. All accuracy 
assessment routines and procedures will then 
be exercised and their output results veri- 
fied. The test results will be supplied to 
the Quality Assurance Manager. 






SECTION 10.0 
RESEARCH REQUIREMENT S 


10.1 CROP ASSESSMENT 

(Req'd by: CAS; Cat., 2; Impl. Resp. : Research) 


The Crop Assessment Subsystem required the follow 
ing research to be conducted. 


10.1.1 Pre-Phase I 

Prior to Phase I, the research effort will be re- 
quired to provide a plan (including schedules) 
to CAS for the conduct of research into improve- 
ments of sampling strategies and identification 
of software and hardware necessary for the im- 
plementation of these techniques. 

10.1.2 Desirable Approaches 

Approaches that may be considered (but not nec- 
essarily limited to) are: 

10.1.2.1 Sampling .-" (Required by: CAS; Category 1; Imple- 
mentation Responsibility: .^CIE-RTEB) . 

A. Develop a standard sampling strategy for all 
LACIE countries, taking into account the 
unique characteristic of each country. Sam- 
pling strategies required by beginning of 
Phase IC . 

B. Develop variable sampling techniques for area 
estimation. A study is to be made of the 
feasibility of using photointerpretation 
data for the purpose of allocating sample 
segments. 

C. Define improvement of sampling strategy pro- 
duced by full-frame registered data as follows: 



1. Develop a model for the variance of an 
acreage estimate based on optimal alloca- 
tions of samples without regard to present 
restricting (i.e., 5x6 mi size and "Landsat 
constraints"). Such a model should include 
not only a sampling variance, but also a 
component of degradation due to signature 
extension errors. Some provision for 
training areas should also be made (Cate- 
gory 2) . 

2. Attempt to quantify th£ above by obtaining 
estimates of variances from work done by 
CAMS on the intensive sites, as well as 
historical data for the last ten years of 
wheat areas by county over the intensive 
test site areas (Category 2). 

' i ‘ ' | ; : \ 

D. Evaluate reduction in sampling error due to 
"cluster sampling" £ provide means to balance 
increased sample error versus reduced clas- 
sification error when classification error 
dependence upon signature extension is known; 
perform such balancing (Category 2) . 

E. Determine the effects on the sample strategy 
due to the increased overlap in the Landsat 
coverage at high latitudes and provide a 
technique of correcting for any bias that 
results from the increased overlap. For ex- 
ample, the overlap' at 29° N is 7.3 percent 
and at 50° N, it is 44.6 percent. This in- 
creases the probability of obtaining cloud 
free acquisition of sample segments at the 
higher latitudes that could bias the sampling 
strategy (Category 1) . 

10. 1.2.2 Aggregation . - (Required by: CAS? Category 1 ; 

Implementation Responsibility: LACIE-RTEB) . 

A. Develop a standard aggregation scheme for 
all LAC IE countries (based on task 10.1.2.2 
above) . 

B. Devise an aggregation scheme which preferen- 
tially incorporates sample segments of higher 
confidence in wheat area estimates. The wheat 
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area estimate for a given substratum (i.e, 
county) will, in general, be a weighted aver- 
age of the historical (ratio) and the current 
(Landsat) estimates. If all segments in a 
county are lost due to clouds, then the 
weights would be 0 for "Landsat" and 1 for 
"ratio". Conversely, if all data is good, 1 
the weights might be. 0 for "ratio" and 1- 
for "Landsat" where is to be determined 

(possibly zero). If some data is available 
but not all, an optimal system of ^weight 
determination must be developed. 

C. Determine a model for the inclusion of cloud 
cover in the sampling area. Cloud cover sta- 
tistics will be combined with the aggregation 
scheme defined above to provide estimates of 
sampling errors introduced by cloud cover 
data loss . ■■ 

10.1.2.3 Harvested Wheat .- (Required by: CAS; Category ! 2; 

Implementation Responsibility: LACIE-RTEB). De- 

velop a technique for estimating the harvested 
wheat area from a combination of the percent 
harvested wheat on a given date from Landsat 
data with the harvest start and stop dates. 


10.2 ACCURACY ASSESSMENT (Req'd by: CAS; Cat. 3; 

Impl. Resp. : LACIE-RTEB) 

Investigation in the following general areas is 
required to study the error propagation in^the 
LACIE system and to support the error analysis 
efforts . 

A. Effect of AI misidentif ication of training 
fields on the classification performance. 


B. Estimation of variability in the area estimate 

due to AI selection procedure for training 
fields, ;• . 

C. Effect of signature extension on classification 
accuracy when signature extension is considered 


i 
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as a function of distance, direction, time- 
phase and properties of analogous areas. 

D. Relationship between the number of classes/ 
subclasses considered, the number of channels 
used and the number of samples employed in 
regard to classification accuracy and the 
area estimation. 

E. Effect of data quality as a function of mis- 
registration, cloud cover and haze, data drop- 
out, on the classification performance. 

F. Different area estimation techniques for the 
bias and the mean square error of a crop pro- 
portion estimate. 

G. Methods for obtaining crop inventory estimates 
when part of the data is missing due to cloud 
cover and haze, data dropouts, etc. 

H. Development of an error model that accounts 
for different types of errors likely to arise 
in the operation of LAC IE system. 


10.2.1 Error Model (Req'd by: CAS; Cat. 1; Impl . Resp. : 

LACIE-RTEB) 

The following interim error budget has been de- 
fined to replace the existing 7-7-2 budget (7 
percent area, 7 percent yield, 2 percent sampling) 
at a national level, with a best estimate of an 
error budget which will permit a 90/90 criteria 
for production, at harvest on a National Level. 
When the TRW developed error model becomes avail- 
able this interim error budget will be updated: 

In order for the production estimate from LAC IE 
to be 90 percent accurate - 90 percent of the 
time a coefficient of variation of the production 
estimate CV (P) of 6 percent or less is per- 
missible provided the estimate is unbiased. Wheat 
production estimate (P) is obtained from the 
product of the wheat area estimate (A) and yield 
estimate (Y) , and A and Y are independent 
: then: 
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CV(P) 


= ( ( CV ( A ) C V ( Y ) ) 2 + CV (A) 2 + CV ( Y ) 2 ) 


If the allowable error is equally shared by area 
and yield, then: ' • : 

CV (A) = CV ( Y ) = V 
Letting CV(P) <; .06 then 

V 4 r 2V 2 = .0036 

'■ . "r 

So, the allowed errors for area and yield 
CV ( A) = V < .0424 now if sampling error, 

CV(SE) is arbitrarily assigned to be 2 percent, 
then : 

CV (A) = (CV (SE) 2 + CV ( CAMS ) 2 ) 


So, the initial LACIE error budget is: 


CV (CAMS) < 3.74 percent j' 

CV (SE) < 2 percent 
CV(Y) < 4.26 percent 

j • ' ■' . . ' ■ ' . 

If a bias in the production estimate is occurring, 
the errors in the estimate of yield and area which 
are allowed would have to be reduced. For example, 
for a bias of 2 percent in the production estimate, 
the CV(P) = 5.4 percent and 


CV ( CAMS ) < 3.25 percent 
CV (SE) < 2 percent 
CV(Y) < 3.82 percent 

The CV (CAMS) 2 = ? - V(S § . ) - 


where CV(CAMS) = overall CAMS CV 

CV(SS) = CV on a sample basis for CAMS 
n = number of sample segments 

acquired ■ 

■Thus, .for n = 200 
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CV(SS) = 37.4 percent 


These error allocations will be revised in 
January 1976 and August 1976, using the accuracy 
assessment and error model results. 
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SECTION 11.0 

TEST AND EVALUATION REQUIREMENTS 


CROP ASSESSMENT 

(Req'd by: CAS; Cat. 2; Impl. Resp.: LACIE-RTEB) 

The Crop Assessment Subsystem requires the follow- 
ing test and evaluation to be conducted: 

A. Prior to Phase IC of the project, the Test and 
Evaluation will be required to plan and imple- 
ment test and evaluation of the procedures for 
calculating acreage and sensitivity of the 
Sampling Strategy. 

B. Prior to Phase II of the project, the Test 
and Evaluation will be required to plan and 
implement test and evaluation of the procedure 
for calculating production and sensitivity of 
the Sampling Strategy. 


ACCURACY ASSESSMENT (Req’d by: CAS; Cat. as 

indicated; Impl. Resp.: LACIE-RTEB) 


The Test and Evaluation is required to evaluate 
the significance of each major source of error 
and their interrelationships with respect to the 
classification performance and the area estima- 
tion. The following evaluations are required to 
be carried out: 

A. Significance of error sources 

1. Evaluate the effect of misregistration on 
the AI and classification performances 
(Category 2) . 


2. Evaluate the effect on classification 

accuracy due to signature extension when 
considered as a function of distance, 
direction f time-phase and properties of 
analogous areas (Category 2). 



3 


Evaluate the significance of AI selection 
for the training fields and the number of 
these fields on the area estimation and 
the classification accuracy (Category 2) . 

4. Evaluate the effect of AI misidentifica- 
tion of fields on the classification 

1 performance (Category 2) . 

5. Evaluate the effect of classification 
performance, on the area estimation, con- 
sidering the classification performance 
as a function of each of the following 
factors (Category 2) : 

a. number of classes/subclasses 

b. number of features 

c. number of samples 
d; threshold limits 

e. a priori probabilities 

f. clustering algorithms used or not used 

6. Evaluate the sampling scheme for the sam- 
pling properties of the area estimate 
(Category 2) . 

Interrelationship between different types of 
performances. Evaluate the following rela- 
tionships with respect to the classification 
performance and the area estimation: 

1. The relationship between the number of 
features used and the number of classes/ 
subclasses considered (Category 2) . 

2. The relationship between the number of 
features used and the number of samples 
employed (Category 2). 

3. The relationship between a signature 
extension factor and a classification 
technique factor . These factor types 


are listed in 11.2 A. 2 and 11.2 A. 5 
(Category 3) . 

4. Thu relationship between the AI per- 
formance and the ADP analyst performance 
(Category 3) . 

C. Test and evaluate. Test and Evaluation are 
required to assess all error models developed 
and/or utilized by the CAS to assess per- 
formance of the LAC IE system (Category 1 ) . 
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APPENDIX A 

SAMPLE SEGMENT ALLOCATION PROCEDURE FOR U.S.A. 

RATIONALE AND PROCEDURE FOR SAMPLE SEGMENT 
ALLOCATION \ND LOCATION FOR THE U.S.A. 

A1.0 SAMPLE SEGMENT ALLOCATION 

All of the following calculations were made 
using the USDA wheat acreage data for the year 
of 1969. 

A. Calculate the proportion of wheat acres for 
each county: 

P, = Acres of wheat in county/total 

acres in k 1 ^ county, P^ = Aw^/At^. 

B. Calculate the standard deviation of the pro- 
portion of wheat for each county: 


C. Calculate the threshold value based on the 
total acres and standard deviation for each 
county : 


t* = At k x a k 
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D. 


Calculate the sum of all the threshold 
values for the country: 


t* = 


N 

Z 

k 


t* 


where N is the total number of counties 
in the country. 

E. Based on 638 sample segments for the U.S.A. 
(n) , calculate the proportional number of 
sample segments alloted to each county: 


t* x 633 
k 

t* 





unrounded calculation 


Repeat steps 4 and 5 for each Crop Reporting 
District (CRD) in the country: 


F.1 


t* . = z t* 

3 k=i k 


where L is the number of counties in the 
j th CRD. 


F . 2 


n j ? ~ 


t* . x 638 

3 

t* 


'nTN = unrounded calculation 

n. = rounded integer value giving the number 

3 ' ... ' '■ ij-Jj 

of segments to be allocated to the j ' CRD 
in the U.S.A. 




Circle indicates unrounded calculations 


G. Stratified Sample Segment.- All counties 


that have an 


r rij\ > 0.500 will have at least 


one sample segment; the actual number of 
segments is the rounded value of fn7\ or 


H. No SampLe Segments.- Ail counties that have 


an 


0.100 will receive no sample 


segments . 


J. Probability Proportional to Size (PPS) Sam- 
ple Segment!- All counties that have an 
^n^ < 0.50 0 and (n^ > 0.100 will have a 

probability of having a sample segment that 
is proportional to the magnitude (numerical 

fT 


size) of their 

value of n . of 
1 

is. Example: 


She 


with respect to the 
CRD in which the county 


n . for CRD = 5 

: 


This means that the CRD will have five sam- 
ple segments. 


County 


Result 

1 

0.08 

no sample 

2 

1 . 63 

two samples (stratified) 

3 

1.10 

one sample (stratified) 

4 

0.30 

PPS 


5 

0.40 

PPS 

| two samples 

6 

0.40 

PPS 

are available 

7 

0.33 

PPS 


Normalize 

, in a 

linear distance, the 


for counties 4, 5, 6, and 7 to a total of 
two for two samples: 


County - 4 = 0.0000 0.4196 
County - 5 = 0.4197 0.9790 
County - 6 = 0 . 9791 1 .5385 
County - 7 = 1 .5386 2,000 
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Select a random number between zero and 
one - 0.3715; this falls in the region of 
county - 4, therefore, it receives a sample 
segment. To determine the second sample 
segment county, add one to the random num- 
ber — 1*3715, which lies in the region of 
county - 6 . 


SAMPLE SEGMENT LOCATION 


A. Equipment required 


(1) Nine Operational Navigation Charts 
(ONC's) covering the U.S. 

(2) Dot matrix, to the scale of the ONC's, 
spaced six nautical miles in the east- 
west direction, and spaced five nauti- 
cal miles in the north-south direction 

(3) A 100 x 100 nautical mile overlay, to 
the scale of the ONC's, with a center 
point surrounded by a 6 x 5 nautical 
mile rectangle, surrounded by a 12 x 
10.5 nautical mile rectangle. The 
boundaries of this larger rectangle 
are drawn out to the edges of the 100 x 
100 nautical mile Landsat (frame bound- 
aries) . Running north-south, 10 nauti- 
cal miles inside the east and west 
boundaries of the 100 x 100 nautical 
mile limits making a rectangle 80 nau- 
tical miles in the east-west direction, 
and 100 nautical miles in the north- 
south direction 

(4) Lists of random numbers covering the 
ranges of 1 to 10, 1 to 20, 1 to 30 , 
etc. , up to 1 to 300 

(5) Data form indicating : State, CRD, 

county, if more than one segment in 
the county indicate which segment is 
being selected; and space to enter: 
number of segments (5 x 6 nautical 
mile rectangles) in the county , number 


of segments in nonagricultural areas 
of the county, number of segments ih 
the agricultural areas of the county, 
handset- 1 track number passing through 
county , latitude and longitude of cen- 
ter of selected sample segment number, 
spring/winter wheat sample segment 

B . Procedure 

(1) Fasten the dot grid to an ONC 

(2) From the data form, select a county; 
locate it and draw its boundaries on 
the ONC 

(3) Count the number of segments in the 
county - a segment is in the county 

it its center point is in the county - 
and enter on data form. If a center 
point of a segment falls exactly on a 
county boundary , flip a coin. If it 
comes up heads, place the segment in 
the county being worked on, if it comes 
up tails, place the segment in the ad- 
jacent county 

(4) Count the number of segments that fall 
entirely in nonagricultural areas and 
enter on form , 

(5) Subtract (d) from (c) and record on 
data form 

(6) Starting with most northwest segment 
in (e) , number all segments determined 
in (e) 

(7) Select lowest random number table that 
includes the last number entered in 

1 step (f ) 

(8) Use first unused random number from 
table; this determines which segment 
is the sample segment 
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Constraints 

(1) Place the center point of the 100 x 
100 nautical mile overlay on the center 
point of the sample segment 

(2) Is there another sample segment within 
the 12 x 10.5 nautical mile rectangle? 

♦Yes - discard newest sample segment 
and go back to step 2(h) 

*No - proceed 

(3) Are there more than four sample seg- 
ments between the extended boundaries 
of the 12 x 10.5 nautical mile rec- 
tangle running in the east-west 
direction? 

♦Yes - discard newest sample segment 
and go back to step 2(h) 

♦No - proceed 

(4) If there are any other sample segments 
falling within the east-west boundaries 
of the 12 x 10.5 nautical mile rec- 
tangle, move the center point of the 
overlay to center points of these seg- 
ments to determine if the new sample 
segment causes there to be more than 
four sample segments within these 
boundaries - 

♦Yes - discard newest sample segment 
and go back to step 2 (h) 

♦No - proceed 

(5) With the center point of the overlay 
back on the center point of the newest 
sample segment; are there more than 
eight sample segments between the ex- 
tended boundaries of the 12 x 10.5 nau- 
tical mile rectangle running in the 
north-south direction? 





♦Yes - discard newest sample segment 
and go back to 2(b) 

♦No - proceed 

(6) If there are any other sample segments 
falling within the north-south extended 
boundaries of the 12 x 10.5 nautical 
mile rectangle, move the center point, 
of the overlay to the center points of 
these segments to determine if the new 
sample segment causes more than eight 
sample segments to be within these 
boundaries - 

♦Yes - discard newest sample segment 
and go back to step 2(h) 

♦No - proceed 

(7) Determine if segment is a spring or 
winter wheat type segment - whichever 
occurs for more than 50 percent of the 
total wheat acreage 

(8) Record remaining data for this sample 
segment 

(9) Return to step 2 (b) 


B1 .0 


B2 .0 
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APPENDIX B* 

SAMPLING AND ESTIMATION PLAN 


SCOPE 

This appendix describes the sampling and aggregation 
requirements for LAC IE Phase III and subsequent activi 
ities. These requirements include a description of 
the sampling scheme as well as procedures for deter- 
mining estimates of wheat area, yield, and produc- 
tion and their associated variances. 


SAMPLE SELECTION PROCEDURE 

The sampling strategy to be used in LACIE will depend 
on whether a country has detailed historical data 
(U.S., Canada, Australia) or whether it only has data 
on one level smaller than the country itself (U. S.S.R. 
China, Argentina, Brazil, India) , In the latter case, 
a standard stratified sampling procedure will be em- 
ployed, while in the first situation the sampling 
strategy will consist of a two-stage stratified prob- 
ability sample in which ’'substrata" (smallest politi- 
cal area for which yields, areas, and crop calendars 
are published) represent the primary sampling units.* 
The 5 by 6 nautical mile segments are the secondary 
units. . 


Sample segments will be allocated to the substrata 
based on weights, w^j^, (see appendix A) which are a 

function of (a) agricultural area in the substratum, 
(b) within-substratum standard deviation of small 
grain area from segment to segment, (c) classifica- 
tion error variance, (d) substratum yield, and (e) 
substratum yield prediction error. Depending upon 
the w. substrata are designated as Group I (high 

sampling rate) , Group II (low sampling rate) and 
Group III (not sampled). (In the U.S., where sub- 
strata are counties, the range of variation of the 


$ 

This allocation procedure was used in U. S. Great 
Plains for Phase III. 
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w. .. is such that in order to meet the 90-90 criterion' 
^ jj ^ 

in | the Great Plains, anywhere from 0 to 5 segments to 
a county are allocated. In foreign areas where the 
strata are larger, several times that number may be 
assigned . ) 

The following sections (B2.1 and B2.2) describe the 
allocation process. 


PRIMARY SAMPLING 

A. DETERMINATION OF TOTAL SAMPLE SIZE 

The total sample size allocated for a country 
should be such that the LAC IE production esti- 
mate satisfies the "90-90" criterion allowing 
for errors due to (a) sampling, <b) classifica- 
tion, (c) yield prediction, and (d) loss of data. 

Using the best available a priori estimates of 
the magnitude of the above errors, one can approx- 
imate the mean-squared prediction error for pro- 
duction as a function of the total sample size, n, 
(see appendix A) . 


PE ( P ) = f(n,-6) (B2.1-1) 


where P is the LACIE production estimate, 6 is a 

A ■ 

set of error parameters, and PE (P) is the root 
mean squared prediction error of P. 

In order to meet the "90-90" criterion, assuming 

■ A ' . . 

P is normally distributed with expectation P, we 

A 

PE (P) 

would like — p—* ~ 1. »06. While it is not unreas- 

A ■ . j ■ 

onable to assume P is normally distributed, there 

A 

may be some bias in P. Therefore, we arrive at a 

A ■ 

PE (p) 

sample size by setting — ~ a where a is smaller 
than .06. Then equation (B2.1-1) can be solved for 

i ft 

This choice was based on an acquisition rate of 
approximately 80 percent. 
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the 



total sample size, n. (Current plans call for 
r x = .05 in the U.S. This results in a sample 

size of 601 for the Croat Plains.)* 


B. DESIGNATION OF GROUP III 

As denoted in appendix A, let P^.^ denote the 

5 historical production (Primary Epoch -Year) for 
the kth substratum, jth stratum and ith zone. 

Let ■ * ' ‘ 

p D = max ( p ! e i e p. .. < .025P 

j ! p ij^ s(p > 3 

where 



S(P) = 


ijk 


ijk 


Pj and 


= EEE 

ijk 


ijk 


(use ordering of P-., r s to obtain the set S(P) 
and hence P ) . - 1 

Then all substrata with P. .. < P_ are excluded 

ijk - o 

from sampling and designated "Group III." No 
segments will be allocated to these substrata 
and the ratio estimation will be used to make 
their area estimates. 

C. DESIGNATION OF GROUPS I AND II 

For all the substrata which are not Group III, 
let 



E'E'E'w 

ijk 


ijk 



where E' denotes summation only over the nonex- 
cluded substrata; then: 
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a. All substrata with wt., > 1.0 are “Group I" 

■ J-3 K . . . 

b. All substrata with wt^ < 1.0 are "Group II" 

. 1 . 

D. COMPUTATION OF SAMPLE SIZES FOR SUBSTRATA 

Specific to this discussion only, an "element" 
shall mean either (a) a Group I substratum or 
(b) the union of all Group II subsfrata within 
a stratum. Let t^j^ represent the "size" of the 

£th element in the jth stratum and ith zone; then 
tij^ = wtv£ if the element is the kth Group I 

substratum or 


t • . n = E w*., 
W kElI iDk 


where " £ " denotes the summation over Group II 

kell 

substrata in the jth stratum and ith zone. 

For each zone i, do the following: 


a. Define n. = rounded E E t- . 

1 . , ijk 

3 k 

b. Let be the provisional allotment where 

n ijk * i nte 9 er part of Also let 


r ijk fc ijk “ n ijk 


and 


r = 


("» - ‘,i "«*) 


c. Assign one additional sample to each of r 
elements with probabilities proportional to 
r ijk? i.e. , let 
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n . . , = n? .. + 6 . , 

ljk ljk jk 


where 6^ 


1 if the jkth element receives an 
extra sample segment; = 0 otherwise. If 

n ijk ~ Ofor a Group H element, then all 


substrata in the element are designated as 
Group III . 

d. For each Group II element assigned a total 

of n ijk sample segments,, choose the substrata 

which receive a segment with probabilities 
proportional to their wheat area in some 
"Epoch Year." Once these substrata are chosen, 
the probabilities of selection, ^jk' arG 

and used in the Group II acreage estimate 
(see section B3.2) even though the designated 
"Epoch Year" may change. 

1 

The Hartley-Rao procedure will be utilized 
to perform the PPS sampling. The details of 
this procedure are documented in appendix C 
for completeness. 


SECONDARY SAMPLING 

Once the number of segments in each substratum has 
been determined from B2.1, the secondary units (5 by 
6 segments) are selected at random within the agricul- 
tural area of the substratum, subject to certain en- 
gineering constraints. See appendix A for details of 
this selection process. 


AREA AGGREGATION 

For zones which do not contain at least three proc- 
essed sample segments do not compute an area estimate. 
In all other cases, wheat area estimates at the seg- 
ment level will be aggregated according to whether 


1 

c.f . Cochran . 

Strata in the case of countries without; detailed 
historical data. 
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they came from a Group I or Group II substratum. Es- 
timates for substrata in Group III are obtained by 
the ratioing procedure described in section B3.3. 

The general aggregation procedure is as follows: 


a • 


For all substrata with w*^ 1.0 (Group I) , 

and for which data exists, compute a stratified 
random sampling estimator of the total wheat 
area (see section 3.1). All substrata (in 
Group I) for which no samples were available 
because of cloud cover are placed in Group 
I I I n If data subsequently becomes available, 
a substratum is reinstated as Group I. 


b. For all substrata with w*j^ 


< 1.0 (Group II) 


compute a PPS estimator of the wheat area. 

(£3ee section 3.2.) If an entire set of Group 
II substrata within a CRD has no available 
segments due to cloud cover, the group of 
substrata is treated as Group III until data 
become available. 

c. For all remaining substrata, plus those for 
which no samples are available due to cloud 
cover, (Group III) , compute a ratio estimate 
of the wheat area (see section 3.3). 

d. The final wheat area estimate shall be the 
sum of the estimates for Groups I, II, and III 


GROUP I AGGREGATION 

The wheat area estimate Is calculated by the following 
equations: 


- A . 

1 jk j k 2-j Ijki 


(B3.1-1) 


at the substratum level and 


L. . 
lj 


to - £ 


k=1 


jk 


(53. 1-2) 
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at tho stratum level where 
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A 1 . - The combined wheat area estimate for the 

Group 1 substrata in the jth stratum. 

L 1 . ~ The number of Group I substrata for which 

classification data are available in the jth 
stratum. 

- The Wheat area estimate of the kth Group 1 

- 1 substratum in the jth stratum. 

’ . . . 

N 1ik = h umber of agricultural segments (after 

exclusion) in the kth substratum. 

M.| . k = The number of sample segments for which class 
ification data are availabe in the kth sub- 
stratum. 


• v = The ratio of the true substratum area to the 
gross pseudo substratum (before exclusion) 
area 


A 1jki ~ The est ^ mat ed wheat area for the ith sample 
. segment in the kth substratum. (See Appen- 

dix E for determination of wheat proportion 
in a segment.) 


PROBABILITY-PROPORTIONAL-TO— SIZE (GROUP II) 
AGGREGATION 


A PPS area estimate is computed for the group of 
substrata within a stratum that are designated as 
Group II. The wheat area estimate is calculated 
using the following equation. 



M 


2j 


^2 R 2j k _2i!i N 2jk 


k— 1 


2 jk 


(B3.2-1 ) 


A 2 ^ k = The wheat area estimate of the sample segment 
belonging to the kth substratum in the jth 
stratum o 


B-7 


M 


2j 


- The number of sample segments in the PPS group 
for which classification data are available. 


^2jk an< * R 2jk are for Group II similar to 

j j, and for Group I. 

The 7r 2jk are P r °P° r tional to the historical wheat area 

in the kth substratum, jth stratum for the designated 
Primary Epoch Year at the time of sample selection 
(see section B2.1) and satisfy E = M 0 _. . Speci- 


. 2 j k 


2 j * 


M 2i W 2^k 

if ically, tt 0 .. = — f= — where W 
23k w 2j 

epoch year harvested wheat area in the kth Group II 
substrata in the jth stratum and W 0 _. = Z W, 


2 jk ~ the primary 


2 j 


2 jk* 


B3.3 GROUP III AGGREGATION 


The wheat area for the Group III substrata will be 
estimated as follows: 

If there are at least three sample segments processed 
in the jth stratum, the Group III area estimate will 
be 


^3 j 


h i±lh± \ w 

I n 3j 


1j 


2 j 


where - the sum of the primary epoch year harvested 

wheat area in the Group I area ' in the jth stratum and 
W 3j = the sum of the primary epoch year harvested wheat 

area in the Group III area in the jth stratum, and 
W 2 j is as defined in Section B3.2. 

If there are less than three sample segments processed 
in the jth stratum, the Group III area estimate will 
be as follows : 
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where denotes summation- over the Group I areas 

j E I 

and ^ " denotes summation over the Group II areas 
jell 

for which classification data are available in the 
zone. 

i • • " ■ i - ■••• . 

B3 . 4 COMBINED STRATUM ESTIMATE 

The wheat area estimate of each stratum will be com- 
puted as the sum of the Group I , Group II, and Group 
III component estimates which comprise the stratum. 


A. = a rj + A 2j + A 3j (B3.3-1) 


If the stratum does not contain a Group III element 
then the sum of the Group I and Group II components 
define the strata estimate. 


Aj = A 1 j + A 2 _. (B3.3-2) 


B4 . 0 AREA VARIANCE ESTIMATION 

In countries which lack detailed historical data no 
- variance estimates are made for strata containing less 




than 3 processed segments. For other strata in such 
countries, the strata variance estimates are obtained 
using equations B4.1-1 and B4, 3-1 . In countries with 
detailed historical data the procedure described below 
in sections B4.1 to B4.4 will be followed. 


B4.1 GROUP I SUBSTRATUM VARIANCE ESTIMATE 

The variance of the wheat area estimate for the Group 
I substrata is computed by: 




k=l 


ijk .2 


M 


1 jk 


'ljk 


(BA .1-1) 


where L,., R 1jk , 


and M-j^ are as defined in 


section B3.1, and S^ k is the within substratum var<- 
iance to be computed according to section B4.3. 


B4.2 VARIANCE OF GROUP II/PPS ESTIMATE 

The variance of the wheat area estimate for the prob- 
ability proportional to size (Group II) substrata is 
computed by: 


V 


2j 


^2j N 2 

V R 2 s 2 

2L, zjk ' 2jk 


k=l 


2jk 


L 2j” 1 L 2j 


E X ( ^k " 2j i - * 


k=l i=k+l 


> (!m . Izji 

"Zjk 7T 2ji 


(B4.1-2) 






where L_ . = number of PPS substrata in ith stratum 
2 J 

and T 1 2jk f L 2j f M 2j' N 2jk f and R 2jk are as ^ e ^^ neci *- n 

2 . 

section B3.2, and is the within substratum var- 

iance to be computed according to section B4.3, and 
for i ? k, 7r 2jki com P uto ^ using the following formula 


M 0 .-] 

2i 

^ m s i .• w U <* ■ i. » • 


2 jki M, 


2j 


4JA 


M..-1 


+ ~2 

m 9 : 

2j 

' y2jk Tf 2 j i ' 

■ 1T 0 .. 

2.1 K. 

M -1 

"2j 

^ 2 j k ^2 j 

/ L 0 . 
2j 

M 3 

2j 

\ a ~i 


*" 1) (3 

- 1 tt nr 

X nr * 


M 3 
2j 


3(M 2i -l) 


3 2 2 

2ji + 7T 2jk 7T 2j 


») 


(”2jk ’2ji + * 


3(M 9 .-1) 
+ *- 

M 2j 


|?? k "23 i) ^ 



2 < M 2_i — 1 > / \ I \ri 3 

m 4 P2jk ? 2jij ^ TT 2ja 
2j V / a=l 
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Also, . 

Y- = Secondary epoch year harvested wheat area in 
3 kth Group II county in the jth stratum. 

Y~ . . = Secondary epoch year harvested wheat area in 
3 ith Group II county in the jth stratum. 

NOTE: If the secondary epoch year data are not 

available then set the second term of the 

1 

variance of A.^ . equal to — — — where T ^ 

3 cy 2 IT 

is the first term of V 9 . given in equation 
B4.1-2. 3 


COMPUTATION OF S^ R AND (WITHIN SUBSTRATUM/ 

STRATUM VARIANCE) 

If the country lacks detailed historical data and 

2 

hence has large strata, only the variance needs 

to be computed and is given by 


M 


1 jk 

i jk = Z « A ijki - 5 ijk> 2 / (M ijk - ij 
i=1 


(B4.3-1) 


If the country has detailed historical data, segments 
within a zone are grouped into collections according 
to their corresponding a priori within substratum 
standard deviations, e^, used in the original alloca- 
tion (see appendix A) . These collections should sat- 
isfy the following conditions: 

a. No collection. should contain less than 8 seg- 
ments unless there are less than 8 segments 
available for the whole zone. 

b. All segments in the same substratum shall be 
in the same collection. 
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c. The number of collections c shall be given 
initially by: 

c - ... 1 provided NS *• 16 

c = 2 provided 16 •_ NS < 24 

c - 3 provided NS _> 24 

■ . - { . . . i 

where NS = the number of available segments 
in the zone. If (a) and (b) above cannot be 
satisfied when NS 16, reduce the value of 
c by one. 

d. If c > 1 , the collections should maximize the 
ratio of the between to within variance of 
the 0^; i.e. , let 


C - T > 

v (V - 0..) 2 /(c - i) 

F _ 3=1 

c d r 

t i (0 rj - e r .) 2 /a d r - c) 

r=l j-1 r 

(B4.3-2) 


where 0 r j = a priori small grains standard 

deviation (see appendix A) associated with 
the substratum containing the jth segment in 
the rth collection (note that segments in the 
same substratum have duplicate 0 . values) 

• J 

and d r = number of segments in rth collection. 

Then the partitioning of the 2 d r segments 

r 

into collections should be such that F is 
maximized subject to the constraints specified 
in (a) and (b) above. If F < 1 reduce c by 1 . 
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A 

Let p . be the CAMS wheat proportion estimate 

for the jth segment of the rth collection and 
let x r j be the Epoch year wheat proportion 

for the substratum containing that segment. 
Then for each of c collections, regress the 


p . on the x . and 
mean square, i.e. , 


let S denote the residual 
r 



(segment area ) 2 ^ ^ (p r - 

j=d 


p .) 2 /(d 
r j r 



where p^ ^ = a + bx r j the predicted value using 
the regression equation) 




£ £ 




(x . - x . ) 
rj r 



(B4.3-3) 


Since by constraint (b) , every substratum is assoc 
iated with one and only one collection, assign the 
2 

variance S^ to every substratum whose segments 

are in the rth collection (whether the substratum 

is Group I or II), i.e., S^ k (or if 

the segments in the kth substratum, jth stratum 
belong to the rth collection. 
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where W|.j , an< 3 W 3j are defined in sections B3.2 

and B3. 3. 

If the jth stratum has at least one but less than three 
segments processed, the estimate of variance for the 
stratum area estimate is given by 



(B4.4-2) 


where A is the set of indices i, such that the ith 
stratum has at least one processed segment. 
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B5.0 
B5. 1 

B5 . 1 


If the jth stratum has no segment processed, the var- 
iance estimate for the strata area estimate is given 
by 


i 



(B4.4-3) 


Remark : There are three categories into which the 

Group III data may fall, each producing a uniquely 
determined variance estimate for the stratum. The 
first category is Group III data in the stratum which 
was estimated from Group I and Group II data within 
its own stratum. The second category is Group III 
data in the stratum which was estimated from all the 
Group I and Group II data within its zone as well as 
the Group I and Group II data within its own stratum. 
The! third category consists of Group III data that was 
estimated from all the Group I and Group II data within 
its zone, but not from Group I or Group II data within 
its; stratum a 


HIGHER LEVEL ESTIMATES 


AREA AGGREGATION TO THE ZONE, REGION, AND COUNTRY 
LEVELS r~'-' 


Wheat area estimates for a zone, region, and country 
are obtained by adding estimates for the strata in- 
cluded in the zone, region, and country. 


Area estimate at the zone levels 

S 

A rz " S A rz j 
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Where, 


S = Number of strata in the zth zone, rth region 
in the country 

A - Area estimate of the jth strata, zth zone, rth 
- 1 region in the country 


B5.1.2 Area estimate at the region level: 



(B5. 1-2) 


Where , 

R = Number of zones in the rth region in the country 


B5.1.3 Area estimate at the country level: 



(B5. 1-3) 


Where , 

K - Number of regions in the country 


B5.2 VARIANCE AGGREGATION TO THE ZONE, REGION, AND COUNTRY 

LEVELS 

For a zone in a country lacking detailed historical 
data the variance estimate is obtained by aggregating 
the strata variances in the zone. 


V - y* V . 
z ZD 

■V j 
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Where V . is the variance of the jth stratum in the 
2 j 

zth zone. Otherwise, use equation B5.2-1. 

B5.2.1 An estimate of the variance at the zone level is 
given by 



(B5.2-1) 


where d is the set of indices associated with strata 

in the zone having at least one processed segment , 77l 
is the set of indices associated with strata in the 
zone which have at least one but less than three seg- 
ments r processed, is the set of indices associated 

with strata having at least three segments processed 

and 71 is the set of indices associated with strata 
containing no processed segments. 

No variance estimation is required for zones which 
do not contain at least three processed sample segments. 
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(B5.2-2) 


B5.2.2 The variance estimate at the region level is 


R 


V r - £ 


V 


rz 


z=1 
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The variance estimate at the country level is 



(B5.2-3) 


B6 . 0 SPRING AND WINTER WHEAT 


B6.1 AREA AND VARIANCE ESTIMATION 

In a mixed wheat area, separate area estimates will 
be made for the winter wheat and the spring wheat 
using the aggregation procedure described in sections 
3.0 through 5.2 with inputs (CAMS/CAS as well as his- 
torical) of winter wheat for a winter wheat aggrega- 
tion and those of spring wheat for a spring wheat 
aggregation except that the 7r w j in sections B3.2 

and B4.2 are unchanged; i,e. they are based upon 
the historical total wheat area for the Group II sub- 
strata. This will provide the spring wheat and the 
winter wheat area estimates and their respective 
* variance estimates at the strata and zone levels. 

The procedures in sections 5.1 and 5.2, are used to 
obtain separate winter wheat and spring wheat area 
estimates and the corresponding variance estimates 
at the regional and country levels. 


B6.2 TOTAL WHEATS AREA AND VARIANCE ESTIMATION 

The total wheat area estimate in a mixed wheat area 
will be computed by aggregating the winter wheat and 
the spring wheat area estimates for the area, that 
is, if A w and A g denote the winter and spring wheat 
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area estimates, respectively, the total wheat area 
estimate, A fc , is given by the equation: 


A. - A 

t w 


+ A 


This will bo done at the strata and higher levels. 

The variance estimates for the total wheat at the 
strata and zone levels will be those obtained from 
the total wheat aggregation to be made with inputs 
of total wheat by CAS for the segments and historical 
data* For any higher level the procedure is the same 
as described in section 5.2. 


B7 . 0 STANDARD STATISTICS 

The standard statistics for area estimation and aggre- 
gation are composed of standard deviation (a) , coef- 
ficient of variation (CV ) ; 90 percent confidence 
limits (CL), and probability of 10 percent relative 

error (ft) . If A and V are the area and variance 

s s 

estimates at some level s, statistics will be calcu- 
lated as follows. 


a = \ V 
s \ s 


(B7.0-1) 

cv s = a; 


(B7.Q-2) 

... • ■ ■■ ... ...i 

CL s (+) = A s + (1 

1.645) a g 

(B7.0-3a) 

CL s l ’ “ A S - <' 

1.645) a ' 

5 

(B7.0-3b) 

ft g = 2 P(x) - 1 


(B7.0-4) 


where P(x) 




1 - 2 (x ) 


( a i 


t + 


a 2 f 


+ a 3 t 
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with t 


1 

1 + px 


B8.0 


B8. 1 



p = 

.3327 

a 1 = 

.4362 

a 2 = 

-. 1202 

a 3 “ 

.9373 

and Z(x) - 

1 



PRODUCTION ESTIMATION 


Production estimates are not generally made at the 
stratum level. Instead, pseudo zones are created in 
a zone if it is covered by more than one yield model. 

A pseudo zone is obtained from the intersection of a 
yield stratum with area strata in a zone. An estimate 
of the production in a pseudo zone is obtained by 
the product of its area estimate times its yield pre- 
diction, and these estimates are aggregated to predict 
zone and higher level production. In mixed areas this 
will be done for each crop-type (winter and spring 
wheat) . To obtain the total production, the separate 
production for each crop-type will be aggregated. 

PREDICTION FOR A ZONE 


Suppose the zone consists of H pseudo zones, , 


? 2 , . o . , G H with acreage estimates A ^,...,A, 


zH 


and 


respectively. 


yield predictions Y zl , Z z2 , . . . , Y^, 

Then the zone production estimate is given by 



m 

■i 


A .Y . 
zi zi 


(B8.1-1) 
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B8.2 PREDICTION ERROR ESTIMATE FOR A ZONE 

An estimate of the squared prediction error of P z 
is given by 


H 



(B8.2-1) 


where U z ^ is the estimated squared prediction error 

of the yield for the ith pseudo zone and V ^ is the 

area variance estimate for the ith pseudo zone and 
is given by 



j eG^ j keG^ 

j#k (B8.2-2) 


here is the area variance estimate for jth stratum 

and is obtained according to the formula in section 
B4.4. in equations (B8.2-1) and (B8*2-2) is the 

estimated covariance between area estimates for the 


jth and kth strata in the zone and is obtained ac- 
cording to the following formulation: 



0 when each of jth and kth strata has at least 
3 segments processed 
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v , . vsj + w 2j * y (v ij + y 


,1k 


(W 


li + V Z (W li + W 2( 


) 


Ujd 


when j tli strata has at. least 3 segments processed 
and kth strata has either no segment or less than 
3 segments processed. 



Sk (V li- V 2i> + V V l k 

Z < w u + v 



+ v 


2k 



W 3 

r .w„ 

(j 3k 

z 

< v u + 

V 2j> 


1 

ic^ 






2 



< w n 

+ W 2i> 



}M 




when each of jth and kth strata has less than 3 but 
at least, one segment processed. 



W 3k< V li * V 

2 <« 1 ± + » 21 > 


3j 3k 


(v n + V 2 P 
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when jth strata has less than 3 but at least one 
segment processed and kth strata with no segment 
processed. 



w w 

3j 3 k 


£ 

\ ie 4 


<W U + W 2i> 


Z) <V li + V 2i> 

ie jd 


when each of jth and kth strata has no segment 
processed. 

The quantities , V 2 j ' w i 1 ' W 2 j ' W 3 ' and the set 

4 are as defined earlier in sections B3.0 through 

5.2. 

In a zone with both spring and winter wheat, pseudo 
zones will be of 3 types, pure spring, pure winter 
and mixed. These pseudo zones will be collections 
of strata to be specified by the MWPZDC (Mixed Wheat 
Pseudo Zone Definition Committee). The variance es- 
timate for total wheat in the zone is obtained from 
(B8.2-1) where Y . and U : are as previously defined 

for the pure pseudo zones (either winter or spring). 

For a mixed wheat pseudo zone, a combined yield pre- 
diction and its squared error, i.e. , Y . , and U . , 
are to be evaluated as follows: 1 


zi 


A Y + A Y 

WQ W SO S 

A + A 
wo so 



A U 1 ^ 2 
wo zw 


+ A U 


so 


1/2 

zs 




+ A ) 
so 



where 


B8.3 


B8.4 


A wo - The primary epoch year harvested winter Wheat 
/u area in the pseudo zone. 

A^ 0 “ The primary epoch year harvested spring wheat area, 
in the pseudo zone . 

U, - The squared prediction error of t.he winter wheat 
yield estimate for the pseudo zone, 

U zs = The squared prediction error of the spring wheat 
yield estimate for the pseudo zone. 


PREDICTION AT THE REGIONAL AND COUNTRY LEVELS 


a. Suppose a region consists of R zones with produc- 


tion estimates P p r 2 / • • • ' 


rR* 


Then the re- 


gional production prediction is obtained by 



b. If a country consists of K regions with production 
estimates , P^,*. P^, 7 then the country produc- 
tion prediction is given by 



PREDICTION ERROR ESTIMATES FOR THE REGIONAL AND 
COUNTRY LEVELS . 

a. An estimate of the squared prediction error of 
P r , the regional production estimate is given by 
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R R R 



2 

where S is the estimated squared prediction 
error of R rz # the production for zth zone and 
S . = 0 if the zth and z'th zones have no yield 
stratum in common. Otherwise, 


Srzz ’ ^ Arik A rjk U rk 


where U ^ is the squared prediction error the 

kth yield stratum estimate commonly applicable 
to the area estimate for the zth zone and 

the area estimate A for the z'th zone, and C 

J. a 

is the number of yield strata common to both the 
zth and z'th zones. 

b. The estimate of the squared prediction error of 
P, the country production estimate is given by 


K 



. 2 

This computation of S assumes that the regional 
production estimates are uncorrelated. (There 
is no reason to doubt this assumption at the 
present time. ) 
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i( 
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ZONE AND REGIONAL YIELD AND PREDICTION ERROR 
ESTIMATION 

When there is a single yield model in a zone, the 
squared prediction error of the zone yield estimate 
provides the variance estimate needed for evaluation, 
i Q e., computation of standard statistics. In case 
of more than one yield model in a zone, the average 
yield estimate and the associated prediction error 
estimate will be computed using the following formulas: 

The average yield estimate for some space (s) is ob- 
tained by 



where P is the production estimate and A is the 
s s 

area estimate for the space ( Zone /region/country ) . 

An estimate of the squared prediction error of 

this average yield estimate is obtained by 



2^i V i 

P s A s 


where 

2 ■ ' . 

S = Estimated squared prediction error of P g , 

& the production estimate. 

V = Estimated variance of A . the area estimate, 
s s ' 

Y^ = Yield estimate for the ith pseudo zone. 

- Estimated variance of the area estimated in 
ith pseudo zone . 


APPENDIX C 


HARTLEY- RAO PROCEDURE* FOR PPS SAMPLING 


Let 


w; . , 


be the sizes of a population of N units for 


which we wish to choose a sample of n with probabilities 
proportional to Z,. 


(a) Define f Q = 0 and accumulate the so that 
£ i - z i r) 
f 2 " z i + Z 2 


N 


V 


i = 1 


(b) Let d = f^ and choose a random number r between 0 and 
~rT 

d. Define x^. - r + (k - l)d 


k 1|2^ ■ « « ^ n 


(c) Choose the ith unit where f. , < x, < f . for some value k 

i 1 “* JL JC X 


'hlfQT HLWm- 


* Cochran, W. G. , Sampling Techniques; Wiley, 1963, p. 263 
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APPENDIX D 


SAMPLING AND ESTIMATION PROCEDURE BASED ON NATURAL STRATA 


1.0 SCOPE 

This document describes the sampling and aggrega- 
tion requirements for the New Sampling Strategy 
for LAC IE Phase III and beyond. These require- 
ments include the sampling scheme as well as 
aggregation procedures for estimating wheat area, 
yield, and production and their associated pre- 
diction error estimates. 


2.0 SAMPLE SELECTION PROCEDURE 


The new sampling strategy to be used in LAC IE 
Phase III and beyond utilizes: 

(1) a stratified random sampling without replace- 
ment scheme, 

(2) "universal" strata developed according to 
specifications oriented toward achieving 
homogeneity in regard to agricultural density, 
soil type, and climatological conditions, and 

(3) the 5x6 nautical mile segment as the sampling 
, unit. 

The total sample size allocated to the area of 
interest should be such that enough segments will 
be available for CAMS processing to produce a 
preassigned (expected) coefficient of variation 
for the estimate of production allowing for errors 


; r ^DHSlG PAGE BLANK 'NOT 
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due to (a) sampling, (b) classification, (o') yield 

i 

prediction, and (d) loss of data. 


3.0 ALLOCATION OF SEGMENTS 


Allocation of segments refers to the determina- 
tion of the total number of segments to be dis- 
tributed among the defined strata. These deter- 
minations will be completed, first of all* for the 
universal strata (i.e. , the strata developed 
irrespective of political subdivision level 
boundaries) . The sample sizes determined for the 
universal strata will then be apportioned to the 
" refined" strata based upon the proportion (rela- 
tive to t.he universal strata) of historical wheat, 
from the epoch year, present in the "refined*' 
strata. The terminology "refined" strata refers 
to the strata that result from the intersection 
of the universal strata with zone-level political 
subdivisions in countries with detailed historical 
data; in countries without detailed historical 

• ■ • 2 

data, the intersection is taken with strata -level 
political subdivisions. The following sections 
(3.1 and 3.2) describe the allocation process to 
be applied to the universal strata. 


i , 

The choice for the preassigned value for the production 
coefficient of variation is dependent upon the desired prob- 
abilistic accuracy of the production estimate for the area 
of interest. For example, if a country level production es- 
timate is to be made, the goal is to obtain a country pro- 
duction estimate, at-harvest, which is within 1 095 of the 
actual production with a probability of .9. This is referred 
to as the 90/90 criterion. 

The use of the word "strata" in this context refers 
specifically to political strata? e.g., strata- level sub- 
divisions in the USSR are oblasts. 
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3.1 DETERMINATION OF TOTAL SAMPLE SIZE 


The total sample size allocated to the area of 
interest should he such that the LACTE error 
budget is achieved for the area estimate allowing 
for errors due to (a) sampling, (b) classification, 
(c) yield prediction and (d) loss of data. Using 
the best available a-priori knowledge of the mag- 
nitude of the above errors, one can approximate 
the mean-squared prediction error for production 
as a function of the total sample size, n. This 
equation can then be solved for n. The resulting 
value is given below: 



where 


n = total number of segments allocated to 
the area of interest, 

, th 

N- = total number of ag segments m the 3 
J universal stratum, 



= estimate of segment- to- segment varia- 

tion of wheat area within the j 
universal stratum, 



average yield potential determined from 

^ 1 i. L j - _ _>th j 


soil characteristics in the j 
stratum, 


universal 



T • = standard deviation of yield potential in 

j th 

the 3 universal stratum, 

J - total number of strata in the area of 

interest , 

CV(P) = preassigned value of the coefficient of 
variation of the production estimate, 



-±M 

j- 1 

Li. 

= estimate of wheat area in the j c universal 
stratum based on historical information, 


and 


5 = a conservative lower “bound estimate of 

the expected, sample acquisition rate by 
the end of a crop season (determined from 
previous experience with loss of segments 
due to cloud cover or other reasons). 

In case n is not an integer, it will be rounded 
upward to the integer just larger than n. 


2 

To compute the wheat area variance, S • , the follow* 

. . . . J . th 

mg procedure will be carried out: if the j 

universal stratum contains at least M. LAC IE 

J 

processed segments from the previous year (Mj 

should default to the value of 3 if no overriding 

2 

value is specified) , Sj will be the computed 

segment-to-segment variation of the previously 
estimated LAC IE wheat area. In case the number 
of LAC IE segments is less than Mj , the estimate 


of the within-stratum wheat area variance will be 
estimated from the following regression equation: 


S . 2 , , v 2 

j = (segment area) 


2 2 
1 4 Sa . 

3 1 


+ c (a. 2 + S*. 2 ) rj (l- rj ) 


(3.1-2) 
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where 


a- = ag area in the collection of ag segments 
' , t h , 

of the j universal stratum computed 
from a complete enumeration of ag pro- 
portion in each 5x6 nautical mile seg- 
ment in the stratum as determined from 
a 5x6 grid overlay onto Lands at color 

.3 

IK imagery , 

rj = gj^/aj where a^ is specified above and 
gj is the historical wheat area in the 
• th 

j universal stratum, 

2 

Sa • = the segment -to -segment with in- stratum 

ag area variance in the collection of 

th. • 

ag segments of the j universal 
stratum computed from the enumeration 
of the 5x6 ag proportions 


and c is a constant obtained by performing a least- 
squares fit to other strata (each of which contains 
at least M_. LACIE segments — M.. should default to 

the value of 3 if no overriding value is specified) 
in the country containing LACIE processed segments 
from the previous year (if too few LACIE segments 
are available in the country of interest, the 
lea st- squares fit should be carried out on strata 
from analogous areas from other countries having 
LACIE processed segments from the previous year). 


Finally, in countries having no historical data 


available, since Sj 


cannot be computed from (3.1-2) 


in this case, it is recommended that S- be re- 


placed by Sa^ 


2 


in (3,1-1). 


3 , 

SFB will produce 5x6 nautical-mile grid overlays for all 
areas to be sampled. These grids will be keyed to the corres- 
ponding ONC's and the percent of agricultural area will be 
computed for each rectangle in the grid from the Landsat imagery 
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DISTRIBUTION OF SAMPLE SIZES AMONG STRATA 


After determining the total number, n, of segments 
to be allocated to the area of interest, as indi- 
cated in the preceding section, the sample size, 

th 

n., to allocate to the j universal stratum will 
3 

be computed as follows: let t. be the weight 

. , th 3 

associated with the j universal stratum where 



and where the quantities to be input into the 
right-hand side of (3.2-1) are as defined in 

section 3.1. Let n? be the provisional allotment 
• th ^ 

to the j universal stratum where nj = integer 
part of t j . Also let 



and 


j=i 


Assign one additional sample segment to each of 
r of the universal strata with probabilities 
proportional to r j ; i.e., let 
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(3.2-2) 


n j » n? + j = 1 ,2 , . . . . , j 

th 

where a j - 1 if the j universal stratum receives 
an extra sample segment; 6 . = 0 otherwise. The 

4 J 

Hartiey-Rao procedure will be utilized to per- 
form the PPS allotment. 

Performing the above procedure results in the de- 
termination of the universal strata sample sizes. 
However, wheat area and production estimates arc 
to be made at the refined strata level and will 
require determinations of sample sik.es for each 
refined stratum. For a given refined stratum, the 
sample size will be determined by multiplying the 
universal stratum sample size by the proportion 
(relative to the universal stratum) of historical 
wheat, from the epoch year, present in the given 
refined stratum. The fractional part of these 
weights account for one or more segments; conse- 
quently, these segments will be assigned to the 
refined strata utilizing the Hartley- Rao PP$ pro- 
cedure with sample sizes proportional to the frac- 
tional parts of the weights in the same manner as 
indicated in the previous paragraph. 


3.3 DESIGNATION OF GROUPS A AND B REFINED STRATA 

In the New Sampling Strategy framework, the j 
refined stratum is designated as a "Group A" or 
"Group B" refined stratum depending on whether it 
is allocated at least Mj or less than Mj segments, 

respectively, where M. defaults to the value of 3 

3 

if no overriding value is specified. The qualita- 
tive definitions are as follows; Group A refined 
strata are those which represent marginal to high 
wheat producing areas whereas Group B refined strata 
represent areas having very little or no wheat his- 
torically. There is one primary exception to this 


4 

c.f. Cochran, W, G., Sampling Techniques ? Wiley, 1963, 
p . 2 6 3 . 
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general qualification: since LAC IE does not get 

coverage on every segment for every pass, any re- 
fined stratum having less than M^. segments after 

such losses shall be placed in the Group B cate- 
gory, If Mj or more segments subsequenly become 

available for aggregation, the refined stratum is 
reinstated as Group A. 


4 . 0 GUIDELINES FOR LOCATING SEGMENTS 

The location of segments within a refined stratum 
will be performed by simple random sampling without 
replacement within the previously designated ag 
area of the stratum. All the segments with 5 % or - 
more ag within the refined stratum will be candi- 
dates for selection. After the selection of the 
sample, the actual acquisitions will be located on 
a mosaic. 1 The latitude and longitude of the center 
of each segment is obtained and delivered to DAPTS 
for ordering/back-ordering. 

5.0 APPORTIONMENT PROCEDURES 


5.1 APPORTIONMENT OF POLITICAL SUBDIVISION DATA TO 

STRATA 


As noted in section 3.1, it may be necessary to 
know the universal stratum historical wheat area 
in order to compute r. for input into (3.1-2) . 

This quantity will also be needed for each refined 
stratum in the aggregation. In countries having 
historical data available only on one level smaller 
than the country itself (e.g. , the oblast level in 
the U.S.S.R.), an apportionment of the political 
subdivision wheat proportional to the universal/ 
refined stratum must be performed . This will be 
accomplished as follows : 


a ii 

g j = w i (5.1-1) 
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whore 


g- = the apportioned estimate of historical 

J th 

wheat area in the j universal/re fined 

stratum, 

a i-i ~ t ^ ie a 9 area i n the collection of ag 

.th 

segments common to the j ' universal/ 

th 

refined stratum and 1 political sub- 
i division, 

= the wheat area in the political sub- 
division based on historical data, 

and 

a- = the total ag area in the collection of 

ag segments of the i 1 " political sub- 
division. 


APPORTIONMENT OF AREA ESTIMATES TO YIELD STRATA 


The Sampling Strategy requires that yield and area 
(universal) strata be coincident. The situation 
may arise, however, where this may not be the case. 
In such cases an apportionment of the acreage esti- 
mate to the yield strata is needed to permit the 
estimate of production at political subidivision 
(or other) levels. The following discussion spec- 
ifies the requirements in support of the New Sam- 
pling Strategy in this case. 

Another set of area strata will be generated con- 
sisting of the collection of all the area "sub- 
strata" that result from the intersection of the 
refined strata with the yield strata. This will 
Result in each yield stratum containing one or 
more area "substrata." The LAC IE wheat area esti- 
mate for each area "substratum" will be obtained by 
apportioning out the LAC IE wheat area estimate of 
the refined stratum according to the proportion of 
ag area in each "substratum" relative to the re- 
fined stratum from which it came. 
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Referring to Illustration 1 below, if the indicated 
yield strata covered the area of interest with {A<j , 

A2,A2, } being the collection of refined strata 

over this same area, then, in view of the lack of 
coincidence of area and yield strata, a new collec- 
tion of area substrata is generated consisting of 

{ A 1 1 /A 12' A 21 ' A 22' A 31 ' A 32' A 41 ' A 51 ' A 52 ' A 53 ' A 54 * * 



•*- 


= the total ag area of Aj^ determined from 

the product of the ag proportion A . . 

"J t 

(determined from the complete enumeration 

of ag in the 5x6 *s ) with the plan ime ter od 

area of A . , , 

li- 


the total ag area of A. (determined from 

J 

the complete enumeration of ag in the 
5x6 's) . 

The above procedure will identify the area "sub- 
strata” and provide associated wheat area estimates 
to be aggregated within each yield stratum to com- 
pute production. It should be observed that the 
procedures discussed in this section will neces- 
sarily be needed for use in the estimate of produc- 
tion and production prediction error in case the 
yield strata are not coincident with the universal 
strata; however, the wheat area estimate for a given 
area of interest will be the same regardless of 
Whether the area aggregation is performed from the 
refined strata or from the substrata (generated 
from intersecting the refined strata with the yield 
strata) . 


6.0 STRATUM AREA ESTIMATION 


6.1 GROUP A REFINED STRATUM AREA ESTIMATE 

tilt 

The wheat area estimate for the j Group A refined 
stratum is calculated as follows: 


and 




" “jA 




( 6 . 1 - 1 ) 
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!i • • • • .. 

where 

= the LAC IE wheat area estimate for the 
j ^ th ^ 

j c Group A refined stratum, 

= the total number of ag segments in the 

^ i j ...j 

3 Group A refined stratum, 

Mj-^ = the total number of sample segments for 

J which classification data is available 

1 . 1 . 

in the j Group A refined stratum, 

A-ii. a = the LAC IE wheat area estimate for the 

k c sample segment in the j Group A 
refined stratum. 


GROUP B REFINED STRATUM AREA ESTIMATE 

• 

The wheat area estimate of the j Group B acreage 
stratum is calculated as follows: 


m 



W-iR = most reGen t epoch year (or average 
over previous two or three years) har- 

■ 4- V* ■■ 

vested wheat area in the j Group B 
stratum. 
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kj 


1, if the k c Group A stratum is 
used in the estimate of the 

• I. 

j Group B stratum 
0, otherwise 


m 


E 

k=l 


d kj A kA 


the sum of the LAC IE estimates of 
wheat area in all Group A strata 
that are used to estimate the given 
• th 

j Group B stratum, 


m 


E d i 


k=1 


kj W kA 


the sum of the most recent epoch 
year (or average over previous two 
to three years) harvested wheat 
area in the Group A strata that 

are used to estimate the j Group 
B stratum, 


m = the total number of Group A strata in 

the area of interest plus any additional 
Group A strata that are not contained 
within the area of interest but that are 
used in the ratio estimation of the Group 
B strata contained in the area of interest, 


n 


jB 


the total number of sample segments for 
which classification data is available in 

-LL 

the j Group B stratum, 


and 


A^d = 0 if n. D = 0; otherwise 

JB JB 


A' = 

n j B 


n j B 


k=1 


A jkB 


( 6 . 2 - 2 ) 
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where' ■ ■ : :;J . .. r . 

N j b = the total number of ag segments in the 
Group B refined stratum 

A* Ur} = the LAC IE wheat area estimate for the 

fh »-h 

k' sample segment in the j * Group B 
stratum. j 

and the capability should exist for Mj to default 

to the value of 3 if no overriding value is speci- 
fied. (Recall that M- is the minimal number of 

segments that must be acquired in the j refined 
stratum before it is designated as a Group A 
stratum. ) 

It should be re-emphasized at this point that the 
most refined level for which historical wheat area 
is available in many LAC IE foreign areas is one 
level below the country level (Crop Region or Econ- 
omic Region). Consequently, the historical wheat 
values for each stratum utilized in the Group B 
estimator must be apportioned to the stratum as 
indicated in section 5.1. 

In the preceding discussion, the Group A strata to 
be utilized as a base for the ratio- estimated part 
of the wheat area estimate of a given Group B 
stratum are to be selected according to the follow- 
ing guidelines! 

(1) First of all, the capability should exist 
to permit interactive selection of the 
appropriate Group A strata as a base in 
the ratio-estimated part of a given Group 
B stratum. 

(2) If (1) is not available (or, if available, 
but not utilized) the software should de- 
fault to the use of all Group A strata (if 
there is at least one) in the zone (con- 
taining the given Group B stratum). 
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7.0 STRATUM WHEAT AREA VARIANCE 

7.1 GROUP A REFINED STRATUM VARIANCE 

The variance of the estimate of wheat area for the 

4" Vi 

j tn Group A refined stratum is given by: 




2 

j'A 


(7.1-1) 


where 



the variance of the j Group A refined 
stratum estimate of wheat area, 



where V? B is the estimate of segment- to -segment 

variance of wheat area computed for the refined 
stratum in the same manner as indicated in section 
3.1 (i.e, by making use of the allocation data at 
the refined stratum level) , if nj B <1 ; otherwise 

(i.e., if 2<nj B <Mj , VjB is estimated directly 

(i.e., in the same manner as the estimate of V., 

— see equation (7.1-1)). 3 


8.0 HIGHER LEVEL ESTIMATES 


8.1 AREA AGGREGATION TO THE ZONE, REGION, AND COUNTY 

LEVELS 


The wheat area estimate. A, of the area of interest 
(whether it be zone, region, or country) is given 
by: 



“j*jA + 


Z 



( 8 . 1 - 1 ) 


where 

till 1 1 

1 , if j Group A refined stratum is 

contained within the area of interest 

0, otherwise 

and m is the total number of Group A strata that 
are contained in the area of interest plus any 
additional Group A strata that are not contained 
within the area of interest but that are used in 
the ratio estimation of the Group B strata con- 
tained in the area of interest. The quanity b 
denotes the total number of Group B strata in the 
area of interest. 
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8.2 


VARIANCE AGGREGATION TO THE ZONE, REGION, AND 
COUNTRY LEVELS 


After substituting the expression in equation 
(6.2-1) into (8.1-1) and simplifying, it is 
straightforward to see that A in (8.1-1) is 
expressible as: 


m 


A = Z “J A jA + Z ( n iB A i B / M i) • 

j=i • • v 


i=1 


( 8 . 2-1 ) 


where 


b 


= V + Z 


3 "3 Ls C ji 

i=1 


Consequently, the variance, V A , for the estimate 

of wheat area for the area of interest is given 
by: 


m 


b 


* A =z 


j=1 


“j v + 


Z ( n i B / M i) V jB 

i-1 


( 8 . 2 - 2 ) 


9.0 

9.1 


SPRING AND WINTER WHEAT 


AREA AND VARIANCE ESTIMATION 


In a mixed wheat area, separate area estimates will 
be made for the winter and the spring wheat using 
the aggregation procedures described in sections 
6 • 0 through 8.2 with inputs (CAMS/CAS as well as 
historical) of winter wheat for a winter wheat ag- 
gregation and those of spring wheat for a spring 
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9.2 


wheat aggregation. This will provide the spring 
wheat and winter wheat area estimates and their 
respective variance estimates at the strata and 
zone levels* The procedures in sections 8.1 and 
8.2 are Used to obtain separate winter wheat and 
spring wheat area estimates and the corresponding 
variance estimates at the zone, regional, and 
country levels. 

TOTAL, WHEAT: AREA AND VARIANCE ESTIMATION 


The total wheat area estimate in a mixed wheat 

area will be computed by aggregating the winter 

wheat and the spring wheat area estimates for the 

area, that is, if A and A denote the winter and 

w s 

spring wheat area estimates, respectively, the 
total wheat area estimate, A fc , is given by 



+ A 


s * 


(9.2-1) 


This will be done at the zone and higher levels. 

The variance estimates! for the total wheat at the 
zone and higher levels will be those obtained from 
the total wheat aggregation to be made with inputs 
of total wheat by CAS for the segments and histor- 
ical data. The procedure is the same as described 
in section 8.2. 


10.0 STANDARD OUTPUT STATISTICS 


The standard statistics for area estimation and 
aggregation are composed of standard deviation (a) , 
coefficient of variation (CV) ; 90 percent confidence 
limits (CL), and probability of 10 percent relative 
error (ft). If A_ and V are the area and variance 

S j s 

estimates at some level s, statistics will be cal- 
culated as follows: 
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Vir 


( 10 . 0 - 1 ) 


11.0 



(10.0-2) 


c. CL ( + ) = A + ( 1 . 64 5) o 

« P S 


( 10 . 0-3a) 


CL. 


(-) 


= A q - (1.645)o . 

o S 


(10. 0—3 b) 


d. = 2 


x) - 1 


where p(x) - 1 - z(x) ^a.,t + a 2 t 2 + a 3 t 3 ^ 
with t == 5 


(10.0-4) 
3' 


x = 


1 + px 

.10 

cv_ 


and 


p = .3327 
a 1 = .4362 
a 2 = -.1202 
a 3 = .9373 


z (x) = 


2 /o 

-x /2 


PRODUCTION ESTIMATION 


11.1 PRODUCTION AND VARIANCE ESTIMATION AT STRATUM 

LEVEL 

The estimate of wheat production for the j th area 
refined stratum (stratum as used here does not 
refer to CRD, oblasts, etc.) is given by: 


0 


p j - 


A • *Y • TV 

JA 3 A 


A.^Y , 
j B j B ' 


if the j refined stratum is 
a Group A stratum 

( 11 . 1 - 1 ) 

i.U 

if the j ‘ refined stratum is 
a Group B stratum 


for 


In the above, Y|. A (Y. R ) is the predicted yield 

i ^ 

the j Group A (Group B) refined stratum as given 
by the yield estimation model. The estimate of the 

prediction error of the Group A refined stratum 

production estimate is given by: 


Z jA 2 * V jA *jA 2 + V 2 A jA 2 - V V 


(11 . 1 - 2 ) 


where A-, and Y- a are the estimates of wheat area 

J A J A th 

and yield, respectively, of the j Group A refined 

stratum and 

V • , = estimate of the wheat area variance for 

th . 

the j Group A refined stratum, 

and 

the estimated squared prediction error 

th 

of yield in the j Group A refined 
stratum. 

The prediction error of the j Group B refined 
stratum production estimate is similarly obtained. 

In case the yield strata are not coincident with 
the universal strata, the estimate of production 
and its associated prediction error estimate at 
the substratum level is given below. In partic- 
ular , if we let denote the production estimate 

of the i th substratum (apportioned from the 
yield stratum which has yield Y r , then , 




where is given by equation (5.2-1), Moreover, 
denoting the production prediction error estimate 
°f j r by we have 


2 2 2 * 2 2 
7 , . . * v . . Y + T W . , - V . . t 4 

ljr i3*r r 13 i3 L r 


( 11 . 1 - 4 ) 


where W . . and Y are the estimates of wheat area 

3 - 1.U 

and yield* respectively, of the i substratum 

1.L 

(contained in the j refined stratum) , and 


V. . 
13 


a ji 


. th 


substratum is 


Vj A , if the i 

contained within the 
Group A refined stratum, 


(11.1-5) 


J Vj B , if the i th substratum is 

^ ' contained within the 

Group B refined stratum. 


The quantities a., and a. are as defined in section 
5.2. 1 


11.2 


PRODUCTION ESTIMATE FOR A ZONE, REGION, OR COUNTRY 
LEVEL - - 


The wheat production estimate* P,, for the area of 

• b i ^ . 

interest (whether it be zone, region, or country 
level) is given by equation (11.2-1) or equation 
(11.2-2), respectively, depending on whether or not 
the yield strata coincide with the universal strata, 
i.e. 
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! 


P A - 


or 


H 


r=1 


m 


Y rj n j A jA + 3 ri A i 


T^A 

j=1 i=1 


iB 


Y r (11 ,2-1 ) 


P A * 


E 

r=1 


m 


E Y rj n j«jA A jA 
j = 1 


b 

+ E 3 

i= 1 


n 


That is , 


H 


P A “ Vr 

r=1 


where 


( 11 , 2 - 2 ) 


m 


A r =E 

j =1 


^3 


n. + e ,c. . 
J L-* n 31 

i-1 


A . _ 
3A 


E ( 3 ri n iB A iB/ M i) 

i=1 


(11.2-3) 


or A r is given by this same expression after re- 

placing y - ^n. by Y rj n jqjA and s ri by 8^. In 

the situation where the universal strata and yield 
strata coincide, equation (11.2-1) applies where 


D-22 



» L 

Y - the LACIE predicted yield in the r 
yield stratum, 

H = the total number of yield strata in the 
area of interest, 

: " i 

- th V 

1, if the j Group A stratum lies 

within (or coincides with) the r c 
yield stratum 

0 , otherwise ' . 

1 , if the i th Group B stratum lies 

within (or coincides with) the r 
yield stratum 

0* otherwise 

and is a variable that defaults to the value of 
3 if no overriding value is specified. 



In the situation where the universal strata and 
yield strata do not coincide, equation (11.2-2) 
applies with Y r and H as defined above; however, 



if the j th Group A stratum intersects 
fch • 

the r yield stratum 


0, otherwise 



if the i Group B stratum intersects 
th 

the r yield stratum 


| 0, otherwise, 


and 


( a iq/ a i) (11.2-5) 


In equations (11.2-4) and 11.2-5), the small a*s 
are as given in section 5.2, m. is the total number 

I J I. U 

of substrata apportioned out of the j*" refined 

Group A stratum and that lies within the r yield 

stratum. Similarly, b- is the total number of sub- 

i , 1 +-h 

strata apportioned out of the i refined Group B 

stratum and that lies within the r ^ yield stratum. 

PRODUCTION PREDICTION ERROR FOR A ZONE, REGION, OR 
COUNTRY LEVEL 



The estimate of the squared prediction error, , 

of the production estimate for the area of interest 
(whether it be zone, region, or country level) is 
given by 


= % [ y t\a + A r 2T r 2 - Vr 2 ] 


H r-1 


-El Y r Y r > COv(A r , A r .^ (11.3-1) 


r = 2 ril 


and 


COV f A .A 'V=y\x . a. yv.* 
V r r ) Z-d D.r jr' j A 


D 
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where 


b 

rg j L-j ri ji , 

! i=l 

the estimated squared prediction error 
of yield in the r*"* 1 yield stratum# 


m 

V rA - 

j=1 

b 

: / + 2 ( e ri n iB / M i) * v iB 

i=1 


The preceding equations apply, of course, to the 
situation where the universal strata and yield 
strata are coincident. If this should not be the 
case, the same equations would still apply provided 
Y r jn j and 3 ri are replaced with Y r jnjqj A and 3 ri q iB # 

respectively, throughout. 


12.0 SPRING AND WINTER WHEAT PRODUCTION 

12.1 PRODUCTION ESTIMATION IN MIXED WHEAT AREAS 

In a mixed wheat area, separate production and pre- 
dicted production error estimates will be made for 
the winter wheat and spring wheat using the proce- 
dures described in section 11.1 - 11.3. The total 
wheat production estimate in a mixed wheat area 
will be computed by aggregating the winter produc- 
tion and the spring production, that is, if P w and 

; . P g denote the winter and spring wheat production 
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Y r j n j 


£ 

i=1 


*ri C ji 


V 


jA 


,2 


and 



12.2 


estimates, respectively, the total wheat production 
estimate, P fc/ is given by: 



( 12 . 1 - 1 ) 


PRODUCTION ERROR ESTIMATES IN MIXED WHEAT AREAS 


The estimate of the production prediction error at 
the area of interest level (whether it be zone, 
region, or country level) in a mixed wheat area 
is given by equations (11.3-1) - (11.3-3) with the 

4-W ! 

following modifications: if the Group A re- 

fined stratum contains mixed wheat and is supplied 

with both a spring, Y^, and winter, Y^, yield es- 
timate then Y r and T ^ i n (11. 3-1) and 11.3-2) a :e 
to be replaced by: 



w , „ s 
^wr Y r sr^r 

*wr + A sr 


( 12 . 2 - 1 ) 


and 




( 12 . 2 - 2 ) 


respectively, where 

A = the epoch year harvested winter wheat area 

Wi 4-V| 

in the r yield stratum, 

A = the epoch year harvested spring wheat area 

■ '■ J_l_ 

in the r yield Stratum, 
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T w = the root mean square of the prediction 
1 error of the winter wheat yioJd estimate 

for the r t ^ yield stratum, 

and 

T S = the root mean square of the prediction 
1 error of the spring wheat yield estimate 

i . i_ 

for the r L yield stratum. 


13.0 AREA OF INTEREST YIELD AND PREDICTION ERROR 

ESTIMATION 

When there is a single yield model covering the area 
of interest, the squared prediction error of the 
yield model provides the variance needed for evalu- 
ation, i.e., for computation of standard statistics. 
In case of more than one yield model in the area of 
interest (whether it be zone, region, or country), 
the average yield estimate and the associated pre- 
diction error estimate will be computed using the 
following formulas: 

The average yield estimate for the area, C, of in- 
terest is obtained by: 



where P c is the production estimate and A c is the 

area estimate for the area of interest. An estimate 
of the squared prediction error of this average yield 
estimate is obtained by: 
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where 


2 

S c = estimated squared prediction error of P c , 
the production estimate, 

V c = estimated prediction error of A c , the area 
estimate, 

= yield estimate for the i yield stratum, 

and 


V. = estimated prediction error of the area 

J- j m i. 

estimate in the i 1 * yield stratum (com- 
puted from use of equation (8.2-2) where 
the area of interest referred to by that 

estimate is the yield stratum in this 
case) . 
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